-- Logs begin at Fri 2022-01-28 00:43:45 UTC, end at Fri 2022-01-28 01:43:02 UTC. -- Jan 28 01:11:49.573982 dv-cinder-826623-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 28 01:11:49.583055 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 01:11:49 2022] *** Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: nodename: dv-cinder-826623-2-iscsi Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: machine: x86_64 Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: clock source: unix Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: pcre jit disabled Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: detected number of CPU cores: 4 Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: current working directory: / Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: detected binary path: /usr/bin/uwsgi-core Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: your processes number limit is 47680 Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: your memory page size is 4096 bytes Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: detected max file descriptor number: 2048 Jan 28 01:11:49.585667 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: lock engine: pthread robust mutexes Jan 28 01:11:49.586435 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: thunder lock: enabled Jan 28 01:11:49.586435 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 28 01:11:49.586435 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 01:11:49.630511 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: Python main interpreter initialized at 0x55d29896f9c0 Jan 28 01:11:49.630511 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: python threads support enabled Jan 28 01:11:49.630511 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: your server socket listen backlog is limited to 100 connections Jan 28 01:11:49.630511 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: your mercy for graceful operations on workers is 90 seconds Jan 28 01:11:49.630834 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 01:11:49.630939 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: *** Operational MODE: preforking *** Jan 28 01:11:49.631231 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: *** uWSGI is running in multiple interpreter mode *** Jan 28 01:11:49.631231 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: spawned uWSGI master process (pid: 79103) Jan 28 01:11:49.631438 dv-cinder-826623-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 28 01:11:49.632151 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: spawned uWSGI worker 1 (pid: 79113, cores: 1) Jan 28 01:11:49.632312 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: spawned uWSGI worker 2 (pid: 79114, cores: 1) Jan 28 01:11:49.632454 dv-cinder-826623-2-iscsi devstack@keystone.service[79103]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 01:11:55.190089 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:11:55.190089 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: from cryptography.utils import int_from_bytes Jan 28 01:11:55.190937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:11:55.190937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: from cryptography.utils import int_from_bytes Jan 28 01:11:55.191348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:11:55.191348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: from cryptography.utils import int_from_bytes Jan 28 01:11:55.191840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:11:55.191840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: from cryptography.utils import int_from_bytes Jan 28 01:11:55.236117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:11:55.236302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:11:55.236302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:11:55.236449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:11:55.236521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] command line args: [] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:11:55.236585 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] command line args: [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:11:55.236720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:11:55.236856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:11:55.236856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ================================================================================ {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:11:55.236973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ================================================================================ {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:11:55.237178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] admin_token = **** {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.237329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] admin_token = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.237411 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] config_dir = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.237478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] config_dir = [] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.237542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.237605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.237674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] config_source = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.237738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] config_source = [] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.237883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] debug = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.238026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] debug = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.238026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.238647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.238647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.238792 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.238855 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.238917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.238984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239237 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] list_limit = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_config_append = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] log_config_append = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_dir = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] log_dir = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.239990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_file = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.240053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] log_file = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.240115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.240176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.240339 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.240426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.240547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.240625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.240786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.240892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.240968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.241049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.241125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.241195 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.241377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.241507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.241573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.241658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.241801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.241891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.242032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.242128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.242344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.242481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.242481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.242623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.242698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.242758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.242931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.243029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.243219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.243351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.243697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.243838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.243838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] publish_errors = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.243987 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] publish_errors = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.244070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.244146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.244291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.244424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.244424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.244669 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.244860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.244997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.245089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.245219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.245375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] standard_threads = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.245503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] standard_threads = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.245503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.245728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.245845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.245955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.246072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.246191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.246303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] use_journal = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.246419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] use_journal = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.246536 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] use_json = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.246653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] use_json = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.246763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] use_stderr = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.246884 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] use_stderr = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.247003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] use_syslog = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.247120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] use_syslog = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.247299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.247450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:11:55.247562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.247684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.247797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.247916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.248033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.248153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.248264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.248452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.248566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.248676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.248785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.248901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.249012 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.249131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.249260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.249373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.249493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.249611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.249722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.249842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.249957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.250069 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.250186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.250303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.250421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.250540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.250652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.250761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.250871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.250986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.251107 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.251227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.251340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.251457 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.251568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.251683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.251805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.251916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.252032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.252149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.252267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.252384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.252506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.252618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.252728 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.252844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.252955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.253070 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.253197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.253348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.253460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.253581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.253693 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.253804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.253994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.254108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.254218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.254327 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.254437 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.254553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.254674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.254793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.254909 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.255020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.255136 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.255247 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.255370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.255489 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.255599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.255715 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.255831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.255942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.256060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.256177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.256288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.256398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.256508 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.256617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.256734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.256846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.256955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.257065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.257174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.257299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.257422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.257536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.257652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.257763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.257873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.257982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.258100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.258219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.258330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.258441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.258552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.258658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.258760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.258886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.258990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.259091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.259187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.259290 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.259386 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.259480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.259582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.259693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.259811 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.259935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.260042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.260166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.260286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.260400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.260511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.260631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.260756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.260869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.260982 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.261094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.261206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.261342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.261467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.261581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.261700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.261804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.261927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.262107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.262232 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.262344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.262456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.262568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.262676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.262795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.262908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.263028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.263142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.263254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.263368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.263479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.263599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.263722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.263836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.263949 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.264060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.264171 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.264283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.264402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.264515 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.264627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.264738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.264859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.264976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.265164 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.265316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.265423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.265534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.265646 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.265757 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.265878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.265992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.266109 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.266223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.266334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.266445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.266565 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.266678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.266790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.266907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.267021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.267133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.267253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.267366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.267490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.267603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.267715 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.267833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.267958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.268083 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.268197 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.268314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.268427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.268537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.268651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.268770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.268886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.269003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.269117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.269267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.269382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.269509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.external = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.269623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] auth.external = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.269735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.269846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.269963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.270077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.270198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.270312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.270422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.password = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.270534 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] auth.password = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.270645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] auth.token = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.270756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] auth.token = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.270880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.270994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.271105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.271218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.271330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.271448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.271569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.271683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.271794 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.271911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.272024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.272141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.272263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.272407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.272533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.272648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] credential.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.272760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.272873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.272985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.273099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.273220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.273350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.273475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.273590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.273703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.273815 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.273935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.274050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.274162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.274275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.274387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.274500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.274620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.274734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.274847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.274960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.275072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.275192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.275317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.275432 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.275551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.275666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.275778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.275898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.276013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.276126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.276237 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.276349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] federation.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.276462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.276582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.276698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.276811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.276924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.277037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.277149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.277297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.277414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.277527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.277646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.277760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.277872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.277994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.278110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.278223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.278335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.278455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.278601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.278792 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.278908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.279021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.279135 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.279247 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.279360 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.279480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.279595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.279708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.279821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.279944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.280058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.280179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.280294 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.280406 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.280519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.280632 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.280632 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.280851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.280966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.281078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.281197 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.281329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.281442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.281567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.281683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.281804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.281918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.282032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.282144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.282268 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.282383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.282507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.282628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.282742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.282855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.282975 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.283099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.283216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.283330 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.283442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.283562 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.283677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.283795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.283909 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.284032 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.284145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.284265 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.284385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.284499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.284612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.284725 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.284837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.284958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.285071 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.285184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.285361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.285476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.285588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.285714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.285831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.285943 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.286056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.286174 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.286289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.286409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.286523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.286636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.286749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.286862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.286974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.287094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.287208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.287327 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.287442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.287554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.287667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.287789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.287904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.288017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.288129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.288242 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.288354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.288475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.288589 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.288701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.288813 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.288927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.289040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.289159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.289343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.289480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.289593 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.289722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.289840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.289967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.290083 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.290196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.290309 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.290423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.290534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.290655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.290770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.290883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.290995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.291109 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.291211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.291331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.291445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.291560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.291673 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.291786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.291899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.292019 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.292135 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.292254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.292368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.292480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.292593 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.292713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.292827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.292939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.293053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.293166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.293328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.293457 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.293578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.293693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.293806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.293918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.294030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.294150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.294266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.294379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.294491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.294604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.294716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.294837 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.294952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.295105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.295220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.295334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.295446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.295566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.295680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.295793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.295906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.296018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.296130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.296254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.296360 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.296472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.296584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.296697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.296810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.296930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.297044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.297157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.297282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.297397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.297520 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.297642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.297756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.297869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.297981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.298095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.298215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.298329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.298443 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.298555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.298667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.298779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.298900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.299014 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.299127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.299239 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.299358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.299473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.299593 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.299707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] resource.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.299823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.299935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.300048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.300160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.300280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.300394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.300509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.300621 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.300733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.300846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.301063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.301184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.301344 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.301459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.301573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.301697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.301823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.301938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.302051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.302164 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] role.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.302277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] role.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.302388 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] role.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.302511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] role.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.302627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.302739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.302851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.302964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.303076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.303076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.303297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.303411 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.303524 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.303638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.303750 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.303871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.303985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.304098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.304210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.304323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.304435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.304556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.304670 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.304789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.304903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.305015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.305128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.305265 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.305381 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.305495 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.305608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.305608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.305820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.305820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.306046 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.306158 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.306270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.306382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.306506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.306621 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.306734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.306847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.306959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.307072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.307192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.307306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.307419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.307531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.307643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.307756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.307877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.307991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.308104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.308216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.308328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.308440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.308561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.308675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.308787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.308901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.309013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.309125 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.309290 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.309406 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.309519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.309631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.309747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.309893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.310023 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.310139 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] token.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.310252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.310364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.310477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.310590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.310711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.310825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.310943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.311057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.311170 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.311283 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.311402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.311517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.311629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.311741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.311854 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.311966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.312088 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.312203 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.312315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.312427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.312539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.312651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.312651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.312871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.312984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.313097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.313209 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.313335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.313460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.313575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.313687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.313800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.313800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.314011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.314131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.314251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.connection = **** {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.314365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.314477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.314477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.314686 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.connection = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.314806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.314920 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.315033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.315146 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.315259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.315414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.315536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.315650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.315763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.315875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.315986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.316098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.316098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.316311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.316423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.316541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.316667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.316790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.316905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.317029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.317151 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.317316 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.317432 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.317545 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.317658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.317770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.317890 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.318004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.318115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.318228 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.318341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.318453 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.318453 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:11:55.318672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.318672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:11:55.318672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:11:55.344555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.344782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.344961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.345041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.345136 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.345391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.353870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.354255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.383508 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.383677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.383810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.383894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.435260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.435627 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.485765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.485907 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.486366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.486598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.550588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.550797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.551054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.551180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.551313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.551420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.551539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.551620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.551682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.551800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.551925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.552090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.574520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.574773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.574878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.575013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.575098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.575161 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.575285 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.575504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.575654 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.575760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.575871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.575959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.576153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.576359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.587316 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.587785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.600366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.600571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.600779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.600918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.601067 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.601148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.601209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.601392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.601392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.601540 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.601615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79114) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.601687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.601880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.602003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79113) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 28 01:11:55.618913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.619063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.619208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:11:55.619288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:11:55.619439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.619586 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.619724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:11:55.619806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 28 01:11:55.619867 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.619985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.620094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.620190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.620354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.620444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.620620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.620742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.631303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.631434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.631579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.631710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.631852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.631953 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.632103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.632229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.640078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.640211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.643252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.643380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.645381 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.645509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.645647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.645746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.645911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.646005 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.646211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.646336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.646472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.646564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.646721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.646846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.646984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.647064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.647227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.647353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.647489 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.647570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.647743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.647882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.673281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.673406 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.674833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.674961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.675090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.675192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.680150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.680279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.680399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.680480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.680677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.680803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.687718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.687845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.687975 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.688077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.692446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.692573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.692694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.692775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.692990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.693136 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.693308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.693388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.693538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.693665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.693821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.693904 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.694053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.694180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.694317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.694412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.712384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.712656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.712783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.712912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.717133 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.717441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.720667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.720923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.721050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.721179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.726199 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.726442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.729806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.730040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.733400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.733599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.733698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.733914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.734040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.734169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.734275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.734446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.734539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.734741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.734865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.735016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.753313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.753544 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.753673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.753801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.753967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.754046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.754108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.754413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.761679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.762066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.763419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.763691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.763816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.764036 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.766645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.766928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.767053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.767192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.767273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.767451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.767617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.767711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.767847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.768038 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.780651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.780923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.781073 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.781160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.781260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.781478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.781606 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.781704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.781771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.782015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.782145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.782337 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.782477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.782625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.799775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.799921 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.802949 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.803078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.806321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.806683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.807856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.808231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.809448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.809739 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.809864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.810004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.810086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.810362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.817122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.817493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.818691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.819030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.821818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.822111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.822236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.822374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.822454 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.822654 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.822794 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.822932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.831625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.831857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.831959 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.832152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.832280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.832418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.839732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79114) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.839946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79113) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 28 01:11:55.840047 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.840246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.840373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.840512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.840591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.840766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.840905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.841082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.841178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.841307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.841397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.841600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.841726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.841864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.841942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.842110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.842237 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.842388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.842470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.842592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.842668 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.842877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.843018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.843223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79114) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.843348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.843467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79113) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 28 01:11:55.880118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d29896f9c0 pid: 79114 (default app) Jan 28 01:11:55.881111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d29896f9c0 pid: 79113 (default app) Jan 28 01:11:55.884364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23b9a1-363a-4fad-a787-24dc04b96ad5 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:11:55.884654 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23b9a1-363a-4fad-a787-24dc04b96ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:11:55.884931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23b9a1-363a-4fad-a787-24dc04b96ad5 None None] PATH_INFO: `/v3` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:11:55.889257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Fri Jan 28 01:11:55 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:04.134265 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b98f-2a4b-4ba4-a70b-1975faeca84f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:04.134814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b98f-2a4b-4ba4-a70b-1975faeca84f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:04.134814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b98f-2a4b-4ba4-a70b-1975faeca84f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:04.140009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:04.146963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74581-8bbc-4828-bb08-71ed52ec7a47 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:04.147605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74581-8bbc-4828-bb08-71ed52ec7a47 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:04.147787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74581-8bbc-4828-bb08-71ed52ec7a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:04.286626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG oslo_db.sqlalchemy.engines [None req-90e74581-8bbc-4828-bb08-71ed52ec7a47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:12:04.477924 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG passlib.handlers.bcrypt [None req-90e74581-8bbc-4828-bb08-71ed52ec7a47 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79114) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 28 01:12:04.478309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG passlib.handlers.bcrypt [None req-90e74581-8bbc-4828-bb08-71ed52ec7a47 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79114) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 28 01:12:04.534279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-90e74581-8bbc-4828-bb08-71ed52ec7a47 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:04.535877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-90e74581-8bbc-4828-bb08-71ed52ec7a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:04.679852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:04.873451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244b98f-2a4b-4ba4-a70b-1975faeca84f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:04.916435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG oslo_db.sqlalchemy.engines [None req-0244b98f-2a4b-4ba4-a70b-1975faeca84f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:12:05.151913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244b98f-2a4b-4ba4-a70b-1975faeca84f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:05.161060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d938f16-4a87-4122-8a48-1f21e6e7753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:05.162182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938f16-4a87-4122-8a48-1f21e6e7753e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:05.162656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938f16-4a87-4122-8a48-1f21e6e7753e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:05.163105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938f16-4a87-4122-8a48-1f21e6e7753e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:05.178116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938f16-4a87-4122-8a48-1f21e6e7753e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:05.231779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5d938f16-4a87-4122-8a48-1f21e6e7753e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 28 01:12:05.232139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938f16-4a87-4122-8a48-1f21e6e7753e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:05.242198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:05.251276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74581-8bbc-4828-bb08-71ed52ec7a47 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:05.275039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74581-8bbc-4828-bb08-71ed52ec7a47 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:05.282226 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fe01d-8512-446d-9338-7d3ae5e3cf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:05.283356 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fe01d-8512-446d-9338-7d3ae5e3cf76 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:05.283641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fe01d-8512-446d-9338-7d3ae5e3cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:05.283910 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fe01d-8512-446d-9338-7d3ae5e3cf76 admin admin] PATH_INFO: `/v3/projects/890dca85d3164528880613bf0afcbf95` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:05.285608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fe01d-8512-446d-9338-7d3ae5e3cf76 admin admin] RBAC: Authorizing `identity:get_project(project_id=890dca85d3164528880613bf0afcbf95)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:05.334818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.common.rbac_enforcer.enforcer [None req-792fe01d-8512-446d-9338-7d3ae5e3cf76 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 28 01:12:05.335151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fe01d-8512-446d-9338-7d3ae5e3cf76 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:05.339821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:05 2022] GET /identity/v3/projects/890dca85d3164528880613bf0afcbf95 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:07.514491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b93df-77f7-447b-b0f6-6af3862b4720 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:07.515330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b93df-77f7-447b-b0f6-6af3862b4720 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:07.515444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b93df-77f7-447b-b0f6-6af3862b4720 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:07.523663 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:07.529450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310ad09-c355-4136-a1cf-aa2b9306d6cd None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:07.529860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310ad09-c355-4136-a1cf-aa2b9306d6cd None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:07.529979 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310ad09-c355-4136-a1cf-aa2b9306d6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:07.550250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-0310ad09-c355-4136-a1cf-aa2b9306d6cd None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:07.551740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0310ad09-c355-4136-a1cf-aa2b9306d6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:07.561116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:07.583893 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b93df-77f7-447b-b0f6-6af3862b4720 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:07.603349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b93df-77f7-447b-b0f6-6af3862b4720 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:07.608708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086aecb-621a-4e3e-a32e-1c83f48d0d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:07.609370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086aecb-621a-4e3e-a32e-1c83f48d0d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:07.609654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086aecb-621a-4e3e-a32e-1c83f48d0d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:07.609912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086aecb-621a-4e3e-a32e-1c83f48d0d29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:07.618463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086aecb-621a-4e3e-a32e-1c83f48d0d29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:07.620264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086aecb-621a-4e3e-a32e-1c83f48d0d29 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:07.629491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:07.635159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310ad09-c355-4136-a1cf-aa2b9306d6cd None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:07.644440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310ad09-c355-4136-a1cf-aa2b9306d6cd None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:07.649785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b9aa-6265-4e9a-a5c9-b6695f820c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:07.650679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b9aa-6265-4e9a-a5c9-b6695f820c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:07.650960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b9aa-6265-4e9a-a5c9-b6695f820c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:07.651229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b9aa-6265-4e9a-a5c9-b6695f820c17 admin admin] PATH_INFO: `/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:07.652755 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2b9aa-6265-4e9a-a5c9-b6695f820c17 admin admin] RBAC: Authorizing `identity:get_user(user_id=16dd35c2d4174b5ab9f9b2bf626a2af7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:07.654669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2b9aa-6265-4e9a-a5c9-b6695f820c17 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:07.656212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:07 2022] GET /identity/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:09.877039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7fa6f-707c-48ec-868a-ab0e4f27d7ef None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:09.877638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7fa6f-707c-48ec-868a-ab0e4f27d7ef None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:09.877638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7fa6f-707c-48ec-868a-ab0e4f27d7ef None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:09.879459 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:09.884652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef3790-d71b-4a41-a375-8eb47e3ff0ac None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:09.885074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef3790-d71b-4a41-a375-8eb47e3ff0ac None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:09.885344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef3790-d71b-4a41-a375-8eb47e3ff0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:09.905937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-09ef3790-d71b-4a41-a375-8eb47e3ff0ac None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:09.907108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-09ef3790-d71b-4a41-a375-8eb47e3ff0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:09.915586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 6/11] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:09.923791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f435ddb-93fb-41b0-b0f0-dc536479ca0f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:09.924076 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f435ddb-93fb-41b0-b0f0-dc536479ca0f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:09.924353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f435ddb-93fb-41b0-b0f0-dc536479ca0f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:09.926145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 6/12] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:09.931972 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53da3a-62fb-47de-9fb4-0fa4a24e6939 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:09.932385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53da3a-62fb-47de-9fb4-0fa4a24e6939 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:09.932809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53da3a-62fb-47de-9fb4-0fa4a24e6939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:09.943233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f435ddb-93fb-41b0-b0f0-dc536479ca0f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:09.954913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-5c53da3a-62fb-47de-9fb4-0fa4a24e6939 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:09.955092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f435ddb-93fb-41b0-b0f0-dc536479ca0f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:09.956113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5c53da3a-62fb-47de-9fb4-0fa4a24e6939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:09.959298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d132-b47b-431f-a483-fb11edfd9058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:09.960061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d132-b47b-431f-a483-fb11edfd9058 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:09.960342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d132-b47b-431f-a483-fb11edfd9058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:09.960613 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d132-b47b-431f-a483-fb11edfd9058 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:09.964390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:09.978187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d132-b47b-431f-a483-fb11edfd9058 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:09.985029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9ae9d132-b47b-431f-a483-fb11edfd9058 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:09.986331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:12:09.986821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53da3a-62fb-47de-9fb4-0fa4a24e6939 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:09.991971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d132-b47b-431f-a483-fb11edfd9058 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:09.996169 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53da3a-62fb-47de-9fb4-0fa4a24e6939 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:10.001527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4247d5-4bed-4d37-ab22-466ce0249fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:10.001698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d132-b47b-431f-a483-fb11edfd9058 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:10.002174 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4247d5-4bed-4d37-ab22-466ce0249fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:10.002456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4247d5-4bed-4d37-ab22-466ce0249fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:10.002730 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4247d5-4bed-4d37-ab22-466ce0249fd3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:10.006091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092d959-6ac0-4c61-bc1c-bf9d9bf553f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:10.006704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092d959-6ac0-4c61-bc1c-bf9d9bf553f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:10.006984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092d959-6ac0-4c61-bc1c-bf9d9bf553f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:10.007257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092d959-6ac0-4c61-bc1c-bf9d9bf553f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:10.008056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092d959-6ac0-4c61-bc1c-bf9d9bf553f2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:10.008355 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092d959-6ac0-4c61-bc1c-bf9d9bf553f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:10.010168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-1092d959-6ac0-4c61-bc1c-bf9d9bf553f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:10.010168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:12:10.010168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:12:10.011074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092d959-6ac0-4c61-bc1c-bf9d9bf553f2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:10.011286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4247d5-4bed-4d37-ab22-466ce0249fd3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:10.013193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4247d5-4bed-4d37-ab22-466ce0249fd3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:10.022336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:10.024853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 8/16] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:10.027838 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4247d5-4bed-4d37-ab22-466ce0249fd3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:10.030361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092d959-6ac0-4c61-bc1c-bf9d9bf553f2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:10.036363 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4247d5-4bed-4d37-ab22-466ce0249fd3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:10.039840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092d959-6ac0-4c61-bc1c-bf9d9bf553f2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:10.040832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817d31-4d9c-43fe-bd91-33ad49d20aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:10.041604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817d31-4d9c-43fe-bd91-33ad49d20aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:10.041886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817d31-4d9c-43fe-bd91-33ad49d20aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:10.042166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817d31-4d9c-43fe-bd91-33ad49d20aa9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:10.043332 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c817d31-4d9c-43fe-bd91-33ad49d20aa9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:10.044908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d67823-3193-4cbb-8331-3ecf7ebdad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:10.045092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c817d31-4d9c-43fe-bd91-33ad49d20aa9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:10.046081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d67823-3193-4cbb-8331-3ecf7ebdad12 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:10.046365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d67823-3193-4cbb-8331-3ecf7ebdad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:10.046868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d67823-3193-4cbb-8331-3ecf7ebdad12 admin admin] PATH_INFO: `/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:10.046968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:10.048661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d67823-3193-4cbb-8331-3ecf7ebdad12 admin admin] RBAC: Authorizing `identity:get_user(user_id=16dd35c2d4174b5ab9f9b2bf626a2af7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:10.050521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d67823-3193-4cbb-8331-3ecf7ebdad12 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:10.052369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:10 2022] GET /identity/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:10.057887 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817d31-4d9c-43fe-bd91-33ad49d20aa9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:10.068669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817d31-4d9c-43fe-bd91-33ad49d20aa9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:10.073644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55660-af67-4c51-b0d0-dd18ece45548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:10.074472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55660-af67-4c51-b0d0-dd18ece45548 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:10.074756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55660-af67-4c51-b0d0-dd18ece45548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:10.075030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55660-af67-4c51-b0d0-dd18ece45548 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:10.076492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55660-af67-4c51-b0d0-dd18ece45548 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:10.078288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55660-af67-4c51-b0d0-dd18ece45548 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:10.079957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:10.086230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d67823-3193-4cbb-8331-3ecf7ebdad12 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:10.097139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d67823-3193-4cbb-8331-3ecf7ebdad12 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:10.102752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898942d0-ce2b-455e-a108-b05f675f4669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:10.103425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898942d0-ce2b-455e-a108-b05f675f4669 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:10.103701 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898942d0-ce2b-455e-a108-b05f675f4669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:10.103971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898942d0-ce2b-455e-a108-b05f675f4669 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:10.104833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898942d0-ce2b-455e-a108-b05f675f4669 admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.domain.id=default, user.id=16dd35c2d4174b5ab9f9b2bf626a2af7) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:10.105147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898942d0-ce2b-455e-a108-b05f675f4669 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:10.106281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-898942d0-ce2b-455e-a108-b05f675f4669 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:10.106281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:12:10.106281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:12:10.107590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898942d0-ce2b-455e-a108-b05f675f4669 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:10.117818 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1343 bytes} [Fri Jan 28 01:12:10 2022] GET /identity/v3/role_assignments?user.id=16dd35c2d4174b5ab9f9b2bf626a2af7&scope.domain.id=default&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 233 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:12.432083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b231ff-5e0d-4cf0-b44b-0c8b055ffb86 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:12.432602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b231ff-5e0d-4cf0-b44b-0c8b055ffb86 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:12.432602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b231ff-5e0d-4cf0-b44b-0c8b055ffb86 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:12.435094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:12.440694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d0783-2ab1-4e6b-82ce-65afc7ce2dbc None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:12.441124 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d0783-2ab1-4e6b-82ce-65afc7ce2dbc None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:12.441308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d0783-2ab1-4e6b-82ce-65afc7ce2dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:12.485134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG passlib.handlers.bcrypt [None req-fb2d0783-2ab1-4e6b-82ce-65afc7ce2dbc None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79113) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 28 01:12:12.485605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG passlib.handlers.bcrypt [None req-fb2d0783-2ab1-4e6b-82ce-65afc7ce2dbc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79113) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 28 01:12:12.538307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-fb2d0783-2ab1-4e6b-82ce-65afc7ce2dbc None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:12.539973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fb2d0783-2ab1-4e6b-82ce-65afc7ce2dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:12.569086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 11/22] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:12.601929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b231ff-5e0d-4cf0-b44b-0c8b055ffb86 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:12.619235 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b231ff-5e0d-4cf0-b44b-0c8b055ffb86 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:12.626122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994dbc9-5947-403d-9f27-37af6ac1085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:12.626122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994dbc9-5947-403d-9f27-37af6ac1085b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:12.626122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994dbc9-5947-403d-9f27-37af6ac1085b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:12.626122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994dbc9-5947-403d-9f27-37af6ac1085b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:12.650238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994dbc9-5947-403d-9f27-37af6ac1085b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:12.657922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-a994dbc9-5947-403d-9f27-37af6ac1085b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:12.663195 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 12/23] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:12.665037 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d0783-2ab1-4e6b-82ce-65afc7ce2dbc None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:12.681403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d0783-2ab1-4e6b-82ce-65afc7ce2dbc None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:12.686376 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dcc08-050f-4bf9-bb3b-29c83a2425e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:12.687369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dcc08-050f-4bf9-bb3b-29c83a2425e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:12.687657 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dcc08-050f-4bf9-bb3b-29c83a2425e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:12.687936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dcc08-050f-4bf9-bb3b-29c83a2425e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:12.688873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dcc08-050f-4bf9-bb3b-29c83a2425e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:12.689178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dcc08-050f-4bf9-bb3b-29c83a2425e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:12.690934 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dcc08-050f-4bf9-bb3b-29c83a2425e4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:12.707797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 12/24] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:12.713430 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994dbc9-5947-403d-9f27-37af6ac1085b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:12.730798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994dbc9-5947-403d-9f27-37af6ac1085b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:12.741485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cd55d-6e7f-4c39-9aaf-fa2b127e724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:12.742649 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cd55d-6e7f-4c39-9aaf-fa2b127e724b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:12.743071 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cd55d-6e7f-4c39-9aaf-fa2b127e724b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:12.743486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93cd55d-6e7f-4c39-9aaf-fa2b127e724b admin admin] PATH_INFO: `/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:12.750351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93cd55d-6e7f-4c39-9aaf-fa2b127e724b admin admin] RBAC: Authorizing `identity:get_user(user_id=16dd35c2d4174b5ab9f9b2bf626a2af7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:12.752586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93cd55d-6e7f-4c39-9aaf-fa2b127e724b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:12.754879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 13/25] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:12 2022] GET /identity/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7 => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:12.760006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dcc08-050f-4bf9-bb3b-29c83a2425e4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:12.778552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dcc08-050f-4bf9-bb3b-29c83a2425e4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:12.785944 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b0604-25b0-4906-b8de-2a1b3e0915cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:12.786777 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b0604-25b0-4906-b8de-2a1b3e0915cf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:12.787061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b0604-25b0-4906-b8de-2a1b3e0915cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:12.787337 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b0604-25b0-4906-b8de-2a1b3e0915cf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:12.788894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b0604-25b0-4906-b8de-2a1b3e0915cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:12.790770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b0604-25b0-4906-b8de-2a1b3e0915cf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:12.792856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 13/26] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:12.798297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cd55d-6e7f-4c39-9aaf-fa2b127e724b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:12.812749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93cd55d-6e7f-4c39-9aaf-fa2b127e724b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:12.821866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88381b78-460a-42b6-bd70-e20983c63a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:12.822929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88381b78-460a-42b6-bd70-e20983c63a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:12.823348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88381b78-460a-42b6-bd70-e20983c63a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:12.823789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88381b78-460a-42b6-bd70-e20983c63a84 admin admin] PATH_INFO: `/v3/domains/default/users/16dd35c2d4174b5ab9f9b2bf626a2af7/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:12.826099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88381b78-460a-42b6-bd70-e20983c63a84 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=16dd35c2d4174b5ab9f9b2bf626a2af7, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:12.828057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-88381b78-460a-42b6-bd70-e20983c63a84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:12.828057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:12:12.828057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:12:12.830343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88381b78-460a-42b6-bd70-e20983c63a84 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:12.984555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1382 bytes} [Fri Jan 28 01:12:12 2022] PUT /identity/v3/domains/default/users/16dd35c2d4174b5ab9f9b2bf626a2af7/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:12.989684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad913b-7f5e-4256-97c5-4ec15bd5ba6c None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:12.989980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad913b-7f5e-4256-97c5-4ec15bd5ba6c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:12.990257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad913b-7f5e-4256-97c5-4ec15bd5ba6c None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:12.993929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 14/28] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:12.999774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229872-2d36-4f21-bbd8-0f02e3695aaf None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:13.000074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229872-2d36-4f21-bbd8-0f02e3695aaf None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:13.000355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6229872-2d36-4f21-bbd8-0f02e3695aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:13.027379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d6229872-2d36-4f21-bbd8-0f02e3695aaf None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:13.029192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d6229872-2d36-4f21-bbd8-0f02e3695aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:13.103545 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:13.150373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad913b-7f5e-4256-97c5-4ec15bd5ba6c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:13.175810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad913b-7f5e-4256-97c5-4ec15bd5ba6c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:13.186716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6170929-da6a-4189-93fc-044b7c21ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:13.187639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6170929-da6a-4189-93fc-044b7c21ebb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:13.188089 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6170929-da6a-4189-93fc-044b7c21ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:13.188501 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6170929-da6a-4189-93fc-044b7c21ebb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:13.189514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6170929-da6a-4189-93fc-044b7c21ebb8 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:13.190679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-e6170929-da6a-4189-93fc-044b7c21ebb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:13.190679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:12:13.190679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:12:13.191870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6170929-da6a-4189-93fc-044b7c21ebb8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:13.207263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c343dd-4654-4cd4-8ac0-6d2e0a765e5b None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:13.207545 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c343dd-4654-4cd4-8ac0-6d2e0a765e5b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:13.207831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c343dd-4654-4cd4-8ac0-6d2e0a765e5b None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:13.213159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:13.219534 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6be82-8ab7-4920-aac3-a80046aa2272 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:13.219821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6be82-8ab7-4920-aac3-a80046aa2272 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:13.220120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6be82-8ab7-4920-aac3-a80046aa2272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:13.254546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9dd6be82-8ab7-4920-aac3-a80046aa2272 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:13.255695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9dd6be82-8ab7-4920-aac3-a80046aa2272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:13.273620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 17/31] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:13.306639 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6be82-8ab7-4920-aac3-a80046aa2272 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:13.323518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6be82-8ab7-4920-aac3-a80046aa2272 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:13.333719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e53f-4d69-41bd-aebd-49ec77f4f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:13.334601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e53f-4d69-41bd-aebd-49ec77f4f9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:13.334888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e53f-4d69-41bd-aebd-49ec77f4f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:13.335165 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e53f-4d69-41bd-aebd-49ec77f4f9eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:13.357682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492e53f-4d69-41bd-aebd-49ec77f4f9eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:13.359710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492e53f-4d69-41bd-aebd-49ec77f4f9eb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:13.369447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 15/32] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:12:13 2022] POST /identity/v3/roles => generated 219 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:13.378625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5d967-9dc8-4b52-b2af-64f6ec96a0e6 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:13.379128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5d967-9dc8-4b52-b2af-64f6ec96a0e6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:13.379573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5d967-9dc8-4b52-b2af-64f6ec96a0e6 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:13.383855 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:13.386461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-b492e53f-4d69-41bd-aebd-49ec77f4f9eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:12:13.389218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f14f3-e839-4aaa-aa91-fc93df68b408 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:13.389865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f14f3-e839-4aaa-aa91-fc93df68b408 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:13.390290 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f14f3-e839-4aaa-aa91-fc93df68b408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:13.393002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 18/34] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:13.398902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e53f-4d69-41bd-aebd-49ec77f4f9eb admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:13.418782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e53f-4d69-41bd-aebd-49ec77f4f9eb admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:13.427802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e18f14f3-e839-4aaa-aa91-fc93df68b408 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:13.428685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ff33e-8c4c-4cec-bd37-0c3d071e0c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:13.429567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ff33e-8c4c-4cec-bd37-0c3d071e0c86 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:13.431415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e18f14f3-e839-4aaa-aa91-fc93df68b408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:13.431991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ff33e-8c4c-4cec-bd37-0c3d071e0c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:13.432277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ff33e-8c4c-4cec-bd37-0c3d071e0c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:13.433083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ff33e-8c4c-4cec-bd37-0c3d071e0c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:13.433415 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ff33e-8c4c-4cec-bd37-0c3d071e0c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:13.434666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-999ff33e-8c4c-4cec-bd37-0c3d071e0c86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:13.434666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:12:13.434666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:12:13.438295 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ff33e-8c4c-4cec-bd37-0c3d071e0c86 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:13.450501 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 17/35] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:13.459277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 19/36] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:13.464542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f14f3-e839-4aaa-aa91-fc93df68b408 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:13.479067 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f14f3-e839-4aaa-aa91-fc93df68b408 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:13.484277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcad60-6412-4ea7-90aa-37189e7b67cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:13.485276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcad60-6412-4ea7-90aa-37189e7b67cd admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:13.485755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcad60-6412-4ea7-90aa-37189e7b67cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:13.486283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcad60-6412-4ea7-90aa-37189e7b67cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:13.487301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcad60-6412-4ea7-90aa-37189e7b67cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:13.488851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-86bcad60-6412-4ea7-90aa-37189e7b67cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:13.488851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:12:13.488851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:12:13.490804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcad60-6412-4ea7-90aa-37189e7b67cd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:13.491274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ff33e-8c4c-4cec-bd37-0c3d071e0c86 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:13.515967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ff33e-8c4c-4cec-bd37-0c3d071e0c86 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:13.534049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f1267-88dc-43de-82f2-a9d7bc87398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:13.534759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1267-88dc-43de-82f2-a9d7bc87398c admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:13.535048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1267-88dc-43de-82f2-a9d7bc87398c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:13.535331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f1267-88dc-43de-82f2-a9d7bc87398c admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:13.536132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f1267-88dc-43de-82f2-a9d7bc87398c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:13.537198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-162f1267-88dc-43de-82f2-a9d7bc87398c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:13.537198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:12:13.537198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:12:13.538218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f1267-88dc-43de-82f2-a9d7bc87398c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:13.556603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:12:13 2022] POST /identity/v3/projects => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:13.565070 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 20/38] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:12:13 2022] POST /identity/v3/roles => generated 225 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:12:14.237545 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c38b-b350-412d-a28a-9339efa08a1f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:14.237952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c38b-b350-412d-a28a-9339efa08a1f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:14.238120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7c38b-b350-412d-a28a-9339efa08a1f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:14.240232 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 19/39] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:14.246264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25739f-c4ec-48f0-808a-de059cf31045 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:14.246597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25739f-c4ec-48f0-808a-de059cf31045 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:14.246836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25739f-c4ec-48f0-808a-de059cf31045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:14.268052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-0b25739f-c4ec-48f0-808a-de059cf31045 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:14.269311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0b25739f-c4ec-48f0-808a-de059cf31045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:14.329073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 21/40] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:14.352618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c38b-b350-412d-a28a-9339efa08a1f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:14.366008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7c38b-b350-412d-a28a-9339efa08a1f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:14.370542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304cf46-78c2-45c3-8397-4676a924b148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:14.371434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304cf46-78c2-45c3-8397-4676a924b148 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:14.371725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304cf46-78c2-45c3-8397-4676a924b148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:14.372007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304cf46-78c2-45c3-8397-4676a924b148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:14.372782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304cf46-78c2-45c3-8397-4676a924b148 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:14.374477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304cf46-78c2-45c3-8397-4676a924b148 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:14.389467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:12:14 2022] POST /identity/v3/roles => generated 223 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:14.488194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d277a2-9667-4382-a4b3-7d877d360182 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:14.488695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d277a2-9667-4382-a4b3-7d877d360182 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:14.488695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d277a2-9667-4382-a4b3-7d877d360182 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:14.490707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 22/42] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:14.496886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35e71-f20d-40dc-a1b4-2824f16d3858 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:14.497464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35e71-f20d-40dc-a1b4-2824f16d3858 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:14.497532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35e71-f20d-40dc-a1b4-2824f16d3858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:14.517793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b3d35e71-f20d-40dc-a1b4-2824f16d3858 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:14.519024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b3d35e71-f20d-40dc-a1b4-2824f16d3858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:14.528178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:14.550954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d277a2-9667-4382-a4b3-7d877d360182 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:14.566535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d277a2-9667-4382-a4b3-7d877d360182 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:14.571697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f726fe7-c4f0-4daf-9f16-782a3e14b3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:14.572512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726fe7-c4f0-4daf-9f16-782a3e14b3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:14.572792 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726fe7-c4f0-4daf-9f16-782a3e14b3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:14.573067 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f726fe7-c4f0-4daf-9f16-782a3e14b3f2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:14.574407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726fe7-c4f0-4daf-9f16-782a3e14b3f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:14.576363 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f726fe7-c4f0-4daf-9f16-782a3e14b3f2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:14.578038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 23/44] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:14.583952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35e71-f20d-40dc-a1b4-2824f16d3858 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:14.593213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35e71-f20d-40dc-a1b4-2824f16d3858 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:14.600253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941871-9e99-4633-b9cb-776101894ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:14.600919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941871-9e99-4633-b9cb-776101894ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:14.601208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941871-9e99-4633-b9cb-776101894ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:14.601514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941871-9e99-4633-b9cb-776101894ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:14.602247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941871-9e99-4633-b9cb-776101894ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:14.604209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941871-9e99-4633-b9cb-776101894ec8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:14.632899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:12:14 2022] POST /identity/v3/projects => generated 312 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:15.536647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383e6a-b565-44e7-963e-5349bc6fa990 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:15.537198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383e6a-b565-44e7-963e-5349bc6fa990 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:15.537198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383e6a-b565-44e7-963e-5349bc6fa990 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:15.539017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 24/46] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:15.544253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566387cd-7b5a-4971-8bed-97af68d1f6d9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:15.544682 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566387cd-7b5a-4971-8bed-97af68d1f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:15.544791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566387cd-7b5a-4971-8bed-97af68d1f6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:15.563954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-566387cd-7b5a-4971-8bed-97af68d1f6d9 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:15.565157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-566387cd-7b5a-4971-8bed-97af68d1f6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:15.633456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 23/47] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:15.656808 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1383e6a-b565-44e7-963e-5349bc6fa990 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:15.670249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1383e6a-b565-44e7-963e-5349bc6fa990 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:15.675675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dcfee-5f97-4f5f-ac9d-d3cc37b1fe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:15.676473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dcfee-5f97-4f5f-ac9d-d3cc37b1fe58 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:15.676736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dcfee-5f97-4f5f-ac9d-d3cc37b1fe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:15.677020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dcfee-5f97-4f5f-ac9d-d3cc37b1fe58 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:15.688011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dcfee-5f97-4f5f-ac9d-d3cc37b1fe58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:15.694767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-db2dcfee-5f97-4f5f-ac9d-d3cc37b1fe58 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:15.695982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:15.701778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566387cd-7b5a-4971-8bed-97af68d1f6d9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:15.711134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566387cd-7b5a-4971-8bed-97af68d1f6d9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:15.716944 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1281aa5-9423-4d29-aaa3-41876ab70af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:15.717745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1281aa5-9423-4d29-aaa3-41876ab70af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:15.718113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1281aa5-9423-4d29-aaa3-41876ab70af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:15.718537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1281aa5-9423-4d29-aaa3-41876ab70af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:15.719403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1281aa5-9423-4d29-aaa3-41876ab70af6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:15.719798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1281aa5-9423-4d29-aaa3-41876ab70af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:15.721561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1281aa5-9423-4d29-aaa3-41876ab70af6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:15.731180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:15.736879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dcfee-5f97-4f5f-ac9d-d3cc37b1fe58 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:15.748083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dcfee-5f97-4f5f-ac9d-d3cc37b1fe58 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:15.753135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fe322-9f32-4295-8871-8548a63732e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:15.754032 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fe322-9f32-4295-8871-8548a63732e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:15.754313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fe322-9f32-4295-8871-8548a63732e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:15.754580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fe322-9f32-4295-8871-8548a63732e3 admin admin] PATH_INFO: `/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:15.755833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fe322-9f32-4295-8871-8548a63732e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=16dd35c2d4174b5ab9f9b2bf626a2af7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:15.757693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fe322-9f32-4295-8871-8548a63732e3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:15.759303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 26/50] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:15 2022] GET /identity/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:15.764819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1281aa5-9423-4d29-aaa3-41876ab70af6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:15.774866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1281aa5-9423-4d29-aaa3-41876ab70af6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:15.779665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb0cbd-b44f-44fd-a51b-a9face11edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:15.780436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0cbd-b44f-44fd-a51b-a9face11edb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:15.780717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0cbd-b44f-44fd-a51b-a9face11edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:15.780980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0cbd-b44f-44fd-a51b-a9face11edb6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:15.782253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb0cbd-b44f-44fd-a51b-a9face11edb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:15.783949 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb0cbd-b44f-44fd-a51b-a9face11edb6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:15.785564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:15.790836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fe322-9f32-4295-8871-8548a63732e3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:15.800605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fe322-9f32-4295-8871-8548a63732e3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:15.805183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35ba09-b4aa-4ac5-9264-c0a5a7a5b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:15.805855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35ba09-b4aa-4ac5-9264-c0a5a7a5b5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:15.806128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35ba09-b4aa-4ac5-9264-c0a5a7a5b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:15.806400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35ba09-b4aa-4ac5-9264-c0a5a7a5b5a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:15.807238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35ba09-b4aa-4ac5-9264-c0a5a7a5b5a6 admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.domain.id=default, user.id=16dd35c2d4174b5ab9f9b2bf626a2af7) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:15.807540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35ba09-b4aa-4ac5-9264-c0a5a7a5b5a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:15.808542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-bd35ba09-b4aa-4ac5-9264-c0a5a7a5b5a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:15.808542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:12:15.808542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:12:15.809711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35ba09-b4aa-4ac5-9264-c0a5a7a5b5a6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:15.816864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 27/52] 10.222.0.16 () {56 vars in 1343 bytes} [Fri Jan 28 01:12:15 2022] GET /identity/v3/role_assignments?user.id=16dd35c2d4174b5ab9f9b2bf626a2af7&scope.domain.id=default&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:16.805990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e406-40e8-4178-a4a9-7780016bf69f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:16.806812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e406-40e8-4178-a4a9-7780016bf69f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:16.806955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80e406-40e8-4178-a4a9-7780016bf69f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:16.809880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 26/53] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:16.816204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f42b9-fba7-43ed-b70c-1aba26a74dcc None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:16.816959 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f42b9-fba7-43ed-b70c-1aba26a74dcc None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:16.817090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f42b9-fba7-43ed-b70c-1aba26a74dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:16.844802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d74f42b9-fba7-43ed-b70c-1aba26a74dcc None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:16.848138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d74f42b9-fba7-43ed-b70c-1aba26a74dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:16.857854 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 28/54] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:16.897152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80e406-40e8-4178-a4a9-7780016bf69f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:16.913756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80e406-40e8-4178-a4a9-7780016bf69f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:16.922743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142b8b6-6102-4235-9e79-63229a3323e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:16.923967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142b8b6-6102-4235-9e79-63229a3323e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:16.924404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142b8b6-6102-4235-9e79-63229a3323e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:16.924847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142b8b6-6102-4235-9e79-63229a3323e0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:16.927102 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142b8b6-6102-4235-9e79-63229a3323e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:16.929941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142b8b6-6102-4235-9e79-63229a3323e0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:16.932500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:16.939132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f42b9-fba7-43ed-b70c-1aba26a74dcc None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:16.948628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f42b9-fba7-43ed-b70c-1aba26a74dcc None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:16.954431 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30214a2b-24e3-4959-a53c-2a1436117a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:16.955092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30214a2b-24e3-4959-a53c-2a1436117a81 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:16.955372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30214a2b-24e3-4959-a53c-2a1436117a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:16.955645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30214a2b-24e3-4959-a53c-2a1436117a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:16.956377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30214a2b-24e3-4959-a53c-2a1436117a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:16.957458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-30214a2b-24e3-4959-a53c-2a1436117a81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:16.957458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:12:16.957458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:12:16.958693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30214a2b-24e3-4959-a53c-2a1436117a81 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:16.994436 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 29/56] 10.222.0.16 () {60 vars in 1161 bytes} [Fri Jan 28 01:12:16 2022] POST /identity/v3/projects => generated 298 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:19.211209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334122-efbb-4562-95d3-a35401fc985e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:19.211754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334122-efbb-4562-95d3-a35401fc985e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:19.211754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334122-efbb-4562-95d3-a35401fc985e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:19.214605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 28/57] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:19.221820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a024b4-872f-448b-8c49-5062ec81561d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:19.222214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a024b4-872f-448b-8c49-5062ec81561d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:19.222452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a024b4-872f-448b-8c49-5062ec81561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:19.251115 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d9a024b4-872f-448b-8c49-5062ec81561d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:19.252312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d9a024b4-872f-448b-8c49-5062ec81561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:19.312633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 30/58] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:19.337505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8334122-efbb-4562-95d3-a35401fc985e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:19.352002 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8334122-efbb-4562-95d3-a35401fc985e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:19.357511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de5bf1-013c-46b1-868d-67473d8edaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:19.358284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de5bf1-013c-46b1-868d-67473d8edaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:19.358567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de5bf1-013c-46b1-868d-67473d8edaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:19.358846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de5bf1-013c-46b1-868d-67473d8edaf1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:19.360157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de5bf1-013c-46b1-868d-67473d8edaf1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:19.361870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de5bf1-013c-46b1-868d-67473d8edaf1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:19.363452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:19.369169 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a024b4-872f-448b-8c49-5062ec81561d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:19.380405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a024b4-872f-448b-8c49-5062ec81561d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:19.385857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6138c2-6a6c-4c00-af68-0694e5427edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:19.386517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6138c2-6a6c-4c00-af68-0694e5427edc admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:19.386801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6138c2-6a6c-4c00-af68-0694e5427edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:19.387073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6138c2-6a6c-4c00-af68-0694e5427edc admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:19.387794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6138c2-6a6c-4c00-af68-0694e5427edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:19.388830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-da6138c2-6a6c-4c00-af68-0694e5427edc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:19.388830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:12:19.388830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:12:19.390106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6138c2-6a6c-4c00-af68-0694e5427edc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:19.418950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 31/60] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:12:19 2022] POST /identity/v3/users => generated 275 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:22.645822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfb21-fded-45b9-bac9-f8577166f2c3 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:22.646357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfb21-fded-45b9-bac9-f8577166f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:22.646357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfb21-fded-45b9-bac9-f8577166f2c3 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:22.648403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 30/61] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:22.653528 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182442fe-b373-4e18-91af-022d3a988d39 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:22.653927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182442fe-b373-4e18-91af-022d3a988d39 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:22.654204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182442fe-b373-4e18-91af-022d3a988d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:22.677387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-182442fe-b373-4e18-91af-022d3a988d39 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:22.678597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-182442fe-b373-4e18-91af-022d3a988d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:22.690732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 32/62] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:22.732508 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfb21-fded-45b9-bac9-f8577166f2c3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:22.746067 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfb21-fded-45b9-bac9-f8577166f2c3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:22.757250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e578cdc-d80d-473c-85ee-3cf756a47f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:22.758315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e578cdc-d80d-473c-85ee-3cf756a47f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:22.758788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e578cdc-d80d-473c-85ee-3cf756a47f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:22.759230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e578cdc-d80d-473c-85ee-3cf756a47f51 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:22.770894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e578cdc-d80d-473c-85ee-3cf756a47f51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:22.778235 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-4e578cdc-d80d-473c-85ee-3cf756a47f51 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:22.780074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 31/63] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:22.786449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182442fe-b373-4e18-91af-022d3a988d39 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:22.798562 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182442fe-b373-4e18-91af-022d3a988d39 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:22.805296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5509b1-b169-494f-a9c2-35c894769611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:22.805983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5509b1-b169-494f-a9c2-35c894769611 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:22.806264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5509b1-b169-494f-a9c2-35c894769611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:22.806535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5509b1-b169-494f-a9c2-35c894769611 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:22.807324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5509b1-b169-494f-a9c2-35c894769611 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:22.807625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5509b1-b169-494f-a9c2-35c894769611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:22.808672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-5f5509b1-b169-494f-a9c2-35c894769611 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:22.808672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:12:22.808672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:12:22.809769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5509b1-b169-494f-a9c2-35c894769611 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:22.832853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 33/64] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:22.838601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e578cdc-d80d-473c-85ee-3cf756a47f51 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:22.857257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e578cdc-d80d-473c-85ee-3cf756a47f51 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:22.862407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b668d-c332-4f08-bce3-1b87fb4ba5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:22.863543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b668d-c332-4f08-bce3-1b87fb4ba5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:22.864024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b668d-c332-4f08-bce3-1b87fb4ba5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:22.864513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b668d-c332-4f08-bce3-1b87fb4ba5dc admin admin] PATH_INFO: `/v3/users/2301f411413942aa83ea957b1ac3e10c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:22.885694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b668d-c332-4f08-bce3-1b87fb4ba5dc admin admin] RBAC: Authorizing `identity:get_user(user_id=2301f411413942aa83ea957b1ac3e10c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:22.888323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b668d-c332-4f08-bce3-1b87fb4ba5dc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:22.896199 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5509b1-b169-494f-a9c2-35c894769611 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:22.897494 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 32/65] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:22 2022] GET /identity/v3/users/2301f411413942aa83ea957b1ac3e10c => generated 275 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:22.920095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5509b1-b169-494f-a9c2-35c894769611 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:22.924994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac1c76-cd42-4106-a7f8-2fb7b36f3490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:22.925970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac1c76-cd42-4106-a7f8-2fb7b36f3490 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:22.926505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac1c76-cd42-4106-a7f8-2fb7b36f3490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:22.926967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac1c76-cd42-4106-a7f8-2fb7b36f3490 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:22.941278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac1c76-cd42-4106-a7f8-2fb7b36f3490 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:22.941999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e02d32-17e2-406a-a55c-efc0772812e0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:22.942525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e02d32-17e2-406a-a55c-efc0772812e0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:22.943015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e02d32-17e2-406a-a55c-efc0772812e0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:22.943122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac1c76-cd42-4106-a7f8-2fb7b36f3490 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:22.945374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 33/66] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:12:22.950599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f012539-05fc-4a88-9954-fe40833a37be None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:22.951100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f012539-05fc-4a88-9954-fe40833a37be None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:22.951596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f012539-05fc-4a88-9954-fe40833a37be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:22.955946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 01:12:22.961385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac1c76-cd42-4106-a7f8-2fb7b36f3490 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:22.970181 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac1c76-cd42-4106-a7f8-2fb7b36f3490 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:22.971444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3f012539-05fc-4a88-9954-fe40833a37be None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:22.972862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3f012539-05fc-4a88-9954-fe40833a37be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:22.982781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 34/68] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:22.989319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef9d41-19e7-4c44-81c7-d73a22c82894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:22.989319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9d41-19e7-4c44-81c7-d73a22c82894 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:22.989319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9d41-19e7-4c44-81c7-d73a22c82894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:22.989319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9d41-19e7-4c44-81c7-d73a22c82894 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:22.989849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef9d41-19e7-4c44-81c7-d73a22c82894 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:22.990568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef9d41-19e7-4c44-81c7-d73a22c82894 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:22.992273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:22 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:22.998140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f012539-05fc-4a88-9954-fe40833a37be None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.013252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f012539-05fc-4a88-9954-fe40833a37be None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.018840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2001a-598c-4417-9936-92f047e3efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.019769 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2001a-598c-4417-9936-92f047e3efb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.020256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2001a-598c-4417-9936-92f047e3efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.020736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2001a-598c-4417-9936-92f047e3efb5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.021908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2001a-598c-4417-9936-92f047e3efb5 admin admin] RBAC: Adding query filter params (role.id=726ccf812eba475187c3df7288e1d46b, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7, user.id=2301f411413942aa83ea957b1ac3e10c) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:23.022431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2001a-598c-4417-9936-92f047e3efb5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.024531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2001a-598c-4417-9936-92f047e3efb5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.036021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 35/70] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:22 2022] GET /identity/v3/role_assignments?user.id=2301f411413942aa83ea957b1ac3e10c&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=726ccf812eba475187c3df7288e1d46b => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:23.037399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef9d41-19e7-4c44-81c7-d73a22c82894 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.057184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef9d41-19e7-4c44-81c7-d73a22c82894 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.078379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9264-6b1f-4c90-bca7-e0fbeead7e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.079586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9264-6b1f-4c90-bca7-e0fbeead7e96 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.079999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9264-6b1f-4c90-bca7-e0fbeead7e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.080406 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e9264-6b1f-4c90-bca7-e0fbeead7e96 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.110104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e9264-6b1f-4c90-bca7-e0fbeead7e96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:23.118680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-026e9264-6b1f-4c90-bca7-e0fbeead7e96 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:23.119952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:12:23.126256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2001a-598c-4417-9936-92f047e3efb5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.143893 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2001a-598c-4417-9936-92f047e3efb5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.158808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cba73-5857-47aa-a777-aab403b177e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.159881 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cba73-5857-47aa-a777-aab403b177e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.160377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cba73-5857-47aa-a777-aab403b177e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.160862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cba73-5857-47aa-a777-aab403b177e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.161930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cba73-5857-47aa-a777-aab403b177e8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:23.162457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cba73-5857-47aa-a777-aab403b177e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.164304 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cba73-5857-47aa-a777-aab403b177e8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.178675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:23.184731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9264-6b1f-4c90-bca7-e0fbeead7e96 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.192962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aafc4-a10a-4b0b-b204-3cbfa64a8971 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.193588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aafc4-a10a-4b0b-b204-3cbfa64a8971 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.194065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aafc4-a10a-4b0b-b204-3cbfa64a8971 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.196145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 37/73] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:12:23.201548 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e9264-6b1f-4c90-bca7-e0fbeead7e96 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.203005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107378b2-8762-430e-b61c-23d08ffae268 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.203343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107378b2-8762-430e-b61c-23d08ffae268 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.203571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107378b2-8762-430e-b61c-23d08ffae268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.208025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d803fd-f27d-44ab-9afe-245069489366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.209264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d803fd-f27d-44ab-9afe-245069489366 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.209755 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d803fd-f27d-44ab-9afe-245069489366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.210212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d803fd-f27d-44ab-9afe-245069489366 admin admin] PATH_INFO: `/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.214056 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d803fd-f27d-44ab-9afe-245069489366 admin admin] RBAC: Authorizing `identity:get_user(user_id=16dd35c2d4174b5ab9f9b2bf626a2af7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.216407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d803fd-f27d-44ab-9afe-245069489366 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.218783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 37/74] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:23.228357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-107378b2-8762-430e-b61c-23d08ffae268 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:23.229624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-107378b2-8762-430e-b61c-23d08ffae268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:23.233653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d803fd-f27d-44ab-9afe-245069489366 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.239018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 38/75] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 28 01:12:23.253256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d803fd-f27d-44ab-9afe-245069489366 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.259685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856eb10-f59c-42b0-a442-014637dcbde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.260582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856eb10-f59c-42b0-a442-014637dcbde5 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.261044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856eb10-f59c-42b0-a442-014637dcbde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.261506 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856eb10-f59c-42b0-a442-014637dcbde5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.272767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856eb10-f59c-42b0-a442-014637dcbde5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.274916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856eb10-f59c-42b0-a442-014637dcbde5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.275231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107378b2-8762-430e-b61c-23d08ffae268 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.285379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 38/76] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 01:12:23.289256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107378b2-8762-430e-b61c-23d08ffae268 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.291231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856eb10-f59c-42b0-a442-014637dcbde5 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.294102 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3e5f-164d-4bb9-8077-833edd8ac0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.295303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3e5f-164d-4bb9-8077-833edd8ac0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.295784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3e5f-164d-4bb9-8077-833edd8ac0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.296249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3e5f-164d-4bb9-8077-833edd8ac0d8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.300824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856eb10-f59c-42b0-a442-014637dcbde5 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.308741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0933ba-cfae-4887-87b7-6b894e523a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.309753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0933ba-cfae-4887-87b7-6b894e523a9d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.310037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0933ba-cfae-4887-87b7-6b894e523a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.310315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0933ba-cfae-4887-87b7-6b894e523a9d admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.311878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c3e5f-164d-4bb9-8077-833edd8ac0d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:23.312076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0933ba-cfae-4887-87b7-6b894e523a9d admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.314539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0933ba-cfae-4887-87b7-6b894e523a9d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.316893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:23.324635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e94c3e5f-164d-4bb9-8077-833edd8ac0d8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:23.326440 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 39/78] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:12:23.328867 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0933ba-cfae-4887-87b7-6b894e523a9d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.334610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3e5f-164d-4bb9-8077-833edd8ac0d8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.340619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0933ba-cfae-4887-87b7-6b894e523a9d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.345663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227a1bc-8b1b-469c-a94a-5ba4f1382f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.347266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a1bc-8b1b-469c-a94a-5ba4f1382f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.347767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a1bc-8b1b-469c-a94a-5ba4f1382f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.348215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a1bc-8b1b-469c-a94a-5ba4f1382f4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.349796 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227a1bc-8b1b-469c-a94a-5ba4f1382f4e admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7, user.id=16dd35c2d4174b5ab9f9b2bf626a2af7) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:23.350426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227a1bc-8b1b-469c-a94a-5ba4f1382f4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.352555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227a1bc-8b1b-469c-a94a-5ba4f1382f4e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.352861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3e5f-164d-4bb9-8077-833edd8ac0d8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.359427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/role_assignments?user.id=16dd35c2d4174b5ab9f9b2bf626a2af7&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:23.361810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e1dd9-08bb-40a8-ad90-08df9556c502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.362733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e1dd9-08bb-40a8-ad90-08df9556c502 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.363226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e1dd9-08bb-40a8-ad90-08df9556c502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.363762 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e1dd9-08bb-40a8-ad90-08df9556c502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.364717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e1dd9-08bb-40a8-ad90-08df9556c502 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:23.365257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e1dd9-08bb-40a8-ad90-08df9556c502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.367179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e1dd9-08bb-40a8-ad90-08df9556c502 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.377052 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 40/80] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:23.386513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227a1bc-8b1b-469c-a94a-5ba4f1382f4e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.402882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227a1bc-8b1b-469c-a94a-5ba4f1382f4e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.418175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb610e6-e09e-4aa3-9214-f8b4f307d807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.419201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb610e6-e09e-4aa3-9214-f8b4f307d807 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.419499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb610e6-e09e-4aa3-9214-f8b4f307d807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.419779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb610e6-e09e-4aa3-9214-f8b4f307d807 admin admin] PATH_INFO: `/v3/users/2301f411413942aa83ea957b1ac3e10c` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.421212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb610e6-e09e-4aa3-9214-f8b4f307d807 admin admin] RBAC: Authorizing `identity:get_user(user_id=2301f411413942aa83ea957b1ac3e10c)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.423497 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb610e6-e09e-4aa3-9214-f8b4f307d807 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.425304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 41/81] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/users/2301f411413942aa83ea957b1ac3e10c => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:23.431126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e1dd9-08bb-40a8-ad90-08df9556c502 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.442737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e1dd9-08bb-40a8-ad90-08df9556c502 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.448169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d5c06-9276-46f0-98ec-849d0ba70ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.449147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d5c06-9276-46f0-98ec-849d0ba70ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.449626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d5c06-9276-46f0-98ec-849d0ba70ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.450123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d5c06-9276-46f0-98ec-849d0ba70ca1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.459697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d5c06-9276-46f0-98ec-849d0ba70ca1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.461809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d5c06-9276-46f0-98ec-849d0ba70ca1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.472931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 41/82] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:23.481391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb610e6-e09e-4aa3-9214-f8b4f307d807 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.494582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb610e6-e09e-4aa3-9214-f8b4f307d807 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.505731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f4cb6-8362-4a29-a2f5-249cb94c7d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.506623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4cb6-8362-4a29-a2f5-249cb94c7d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.506904 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4cb6-8362-4a29-a2f5-249cb94c7d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.507181 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4cb6-8362-4a29-a2f5-249cb94c7d54 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.514282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f4cb6-8362-4a29-a2f5-249cb94c7d54 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.516431 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f4cb6-8362-4a29-a2f5-249cb94c7d54 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.518655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 42/83] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:23.524522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d5c06-9276-46f0-98ec-849d0ba70ca1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.535028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d5c06-9276-46f0-98ec-849d0ba70ca1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.545989 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187ef0b-12f0-483b-b95b-defc61abd4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.547057 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187ef0b-12f0-483b-b95b-defc61abd4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.547507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187ef0b-12f0-483b-b95b-defc61abd4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.547989 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187ef0b-12f0-483b-b95b-defc61abd4d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.549017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187ef0b-12f0-483b-b95b-defc61abd4d9 admin admin] RBAC: Adding query filter params (role.id=7cc6510c2843471b8db1852425803574, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7, user.id=2301f411413942aa83ea957b1ac3e10c) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:23.549558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187ef0b-12f0-483b-b95b-defc61abd4d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.551722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187ef0b-12f0-483b-b95b-defc61abd4d9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.561562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/role_assignments?user.id=2301f411413942aa83ea957b1ac3e10c&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=7cc6510c2843471b8db1852425803574 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:23.662892 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c1808-15a2-4e39-a987-1582b1a86feb None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.663405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c1808-15a2-4e39-a987-1582b1a86feb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.663405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c1808-15a2-4e39-a987-1582b1a86feb None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.665623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 43/85] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:23.671326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491fd97-2d20-4073-8969-d268da21b767 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.672152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491fd97-2d20-4073-8969-d268da21b767 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.672614 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491fd97-2d20-4073-8969-d268da21b767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.694582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ec01-510b-46cb-96fc-cc4396621cef None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.694867 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ec01-510b-46cb-96fc-cc4396621cef None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.695148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535ec01-510b-46cb-96fc-cc4396621cef None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.697181 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 44/86] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:23.702542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40676ee-926a-41c4-a794-cfa046974cb4 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.702826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40676ee-926a-41c4-a794-cfa046974cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.703102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40676ee-926a-41c4-a794-cfa046974cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.708781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3491fd97-2d20-4073-8969-d268da21b767 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:23.711553 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3491fd97-2d20-4073-8969-d268da21b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:23.726274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d40676ee-926a-41c4-a794-cfa046974cb4 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:23.731113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 43/87] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 28 01:12:23.731356 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d40676ee-926a-41c4-a794-cfa046974cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:23.740282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 45/88] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:23.766408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491fd97-2d20-4073-8969-d268da21b767 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.772319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40676ee-926a-41c4-a794-cfa046974cb4 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.781156 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491fd97-2d20-4073-8969-d268da21b767 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.790182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b7a66-8d98-466a-bd9b-8cea05017793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.790995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b7a66-8d98-466a-bd9b-8cea05017793 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.791335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b7a66-8d98-466a-bd9b-8cea05017793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.791613 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b7a66-8d98-466a-bd9b-8cea05017793 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.792957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b7a66-8d98-466a-bd9b-8cea05017793 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.795975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40676ee-926a-41c4-a794-cfa046974cb4 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.796903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b7a66-8d98-466a-bd9b-8cea05017793 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.799195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 44/89] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:23.802811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0ce85-6980-4993-bb6c-1f8890677ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.803672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ce85-6980-4993-bb6c-1f8890677ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.803954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ce85-6980-4993-bb6c-1f8890677ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.804228 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0ce85-6980-4993-bb6c-1f8890677ff3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.808324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b7a66-8d98-466a-bd9b-8cea05017793 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.820679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b7a66-8d98-466a-bd9b-8cea05017793 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.829700 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0ce85-6980-4993-bb6c-1f8890677ff3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:23.831424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912b79-0ea1-43e7-a776-7be8a0e2b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.833256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912b79-0ea1-43e7-a776-7be8a0e2b56b admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.833592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912b79-0ea1-43e7-a776-7be8a0e2b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.833914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912b79-0ea1-43e7-a776-7be8a0e2b56b admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.835223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912b79-0ea1-43e7-a776-7be8a0e2b56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.837581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-ae912b79-0ea1-43e7-a776-7be8a0e2b56b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:23.837581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:12:23.837581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:12:23.841059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912b79-0ea1-43e7-a776-7be8a0e2b56b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.846142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-abc0ce85-6980-4993-bb6c-1f8890677ff3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:23.849625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:23.855340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0ce85-6980-4993-bb6c-1f8890677ff3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.867481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0ce85-6980-4993-bb6c-1f8890677ff3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.875428 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f225b-7e2a-4ca3-b6cf-140a72821029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.876829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f225b-7e2a-4ca3-b6cf-140a72821029 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.878094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f225b-7e2a-4ca3-b6cf-140a72821029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.878381 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f225b-7e2a-4ca3-b6cf-140a72821029 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.882932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 45/91] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:12:23 2022] POST /identity/v3/users => generated 289 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:12:23.884846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f225b-7e2a-4ca3-b6cf-140a72821029 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:23.885253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f225b-7e2a-4ca3-b6cf-140a72821029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.886957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f225b-7e2a-4ca3-b6cf-140a72821029 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.908961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 47/92] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:23.916745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912b79-0ea1-43e7-a776-7be8a0e2b56b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.931425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912b79-0ea1-43e7-a776-7be8a0e2b56b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.940941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d7c9f-aa97-459d-9ba5-c308b14a17f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.941865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d7c9f-aa97-459d-9ba5-c308b14a17f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.942194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d7c9f-aa97-459d-9ba5-c308b14a17f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.942471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d7c9f-aa97-459d-9ba5-c308b14a17f6 admin admin] PATH_INFO: `/v3/users/2301f411413942aa83ea957b1ac3e10c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:23.950327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d7c9f-aa97-459d-9ba5-c308b14a17f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2301f411413942aa83ea957b1ac3e10c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:23.952808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d7c9f-aa97-459d-9ba5-c308b14a17f6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:23.955033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 46/93] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/users/2301f411413942aa83ea957b1ac3e10c => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:23.960352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f225b-7e2a-4ca3-b6cf-140a72821029 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:23.984176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f225b-7e2a-4ca3-b6cf-140a72821029 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:23.990503 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f206edd-622b-42b0-9e08-c2d4836d68d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:23.991193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f206edd-622b-42b0-9e08-c2d4836d68d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:23.991483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f206edd-622b-42b0-9e08-c2d4836d68d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:23.991760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f206edd-622b-42b0-9e08-c2d4836d68d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:24.005393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f206edd-622b-42b0-9e08-c2d4836d68d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:24.007228 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f206edd-622b-42b0-9e08-c2d4836d68d1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:24.023669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 48/94] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:24.029448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d7c9f-aa97-459d-9ba5-c308b14a17f6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:24.047163 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d7c9f-aa97-459d-9ba5-c308b14a17f6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:24.055656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d78779-8a48-4de0-8457-babf9a7b5e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:24.056530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d78779-8a48-4de0-8457-babf9a7b5e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:24.056862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d78779-8a48-4de0-8457-babf9a7b5e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:24.057145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d78779-8a48-4de0-8457-babf9a7b5e9e admin admin] PATH_INFO: `/v3/projects/99359a7cbed64b758a0c058817fdbf7a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:24.062084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d78779-8a48-4de0-8457-babf9a7b5e9e admin admin] RBAC: Authorizing `identity:get_project(project_id=99359a7cbed64b758a0c058817fdbf7a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:24.064276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d78779-8a48-4de0-8457-babf9a7b5e9e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:24.066480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 47/95] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:24 2022] GET /identity/v3/projects/99359a7cbed64b758a0c058817fdbf7a => generated 312 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:24.072213 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f206edd-622b-42b0-9e08-c2d4836d68d1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:24.086677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f206edd-622b-42b0-9e08-c2d4836d68d1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:24.097743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1c964-2e3d-4424-aa4e-84ef22d46ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:24.098436 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1c964-2e3d-4424-aa4e-84ef22d46ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:24.099093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1c964-2e3d-4424-aa4e-84ef22d46ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:24.099370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1c964-2e3d-4424-aa4e-84ef22d46ed2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:24.100238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1c964-2e3d-4424-aa4e-84ef22d46ed2 admin admin] RBAC: Adding query filter params (role.id=726ccf812eba475187c3df7288e1d46b, scope.project.id=99359a7cbed64b758a0c058817fdbf7a, user.id=2301f411413942aa83ea957b1ac3e10c) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:24.100551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1c964-2e3d-4424-aa4e-84ef22d46ed2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:24.102505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1c964-2e3d-4424-aa4e-84ef22d46ed2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:24.113917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:24 2022] GET /identity/v3/role_assignments?user.id=2301f411413942aa83ea957b1ac3e10c&scope.project.id=99359a7cbed64b758a0c058817fdbf7a&role.id=726ccf812eba475187c3df7288e1d46b => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:25.530672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f129-b6aa-4751-ad4a-3fde2cc0dea0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:25.531377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f129-b6aa-4751-ad4a-3fde2cc0dea0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:25.531377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f129-b6aa-4751-ad4a-3fde2cc0dea0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:25.533024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 48/97] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:25.538439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253fee-6279-4b15-8450-f15cc1b8901c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:25.538908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253fee-6279-4b15-8450-f15cc1b8901c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:25.539053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28253fee-6279-4b15-8450-f15cc1b8901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:25.566205 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-28253fee-6279-4b15-8450-f15cc1b8901c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:25.567400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-28253fee-6279-4b15-8450-f15cc1b8901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:25.575572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 50/98] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:25.611276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7f129-b6aa-4751-ad4a-3fde2cc0dea0 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:25.629866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7f129-b6aa-4751-ad4a-3fde2cc0dea0 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:25.634350 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bdedf-f97f-4359-a18e-e3e7dee8d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:25.635150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bdedf-f97f-4359-a18e-e3e7dee8d421 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:25.635428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bdedf-f97f-4359-a18e-e3e7dee8d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:25.635701 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bdedf-f97f-4359-a18e-e3e7dee8d421 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:25.653382 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bdedf-f97f-4359-a18e-e3e7dee8d421 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:25.660455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9a9bdedf-f97f-4359-a18e-e3e7dee8d421 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:25.661715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 49/99] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:25.667682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28253fee-6279-4b15-8450-f15cc1b8901c None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:25.682181 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28253fee-6279-4b15-8450-f15cc1b8901c None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:25.692239 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dec6d8-48d9-4fdc-af96-d094f37b9733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:25.692973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dec6d8-48d9-4fdc-af96-d094f37b9733 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:25.693278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dec6d8-48d9-4fdc-af96-d094f37b9733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:25.693561 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dec6d8-48d9-4fdc-af96-d094f37b9733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:25.694344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dec6d8-48d9-4fdc-af96-d094f37b9733 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:25.694649 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dec6d8-48d9-4fdc-af96-d094f37b9733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:25.696268 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dec6d8-48d9-4fdc-af96-d094f37b9733 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:25.709105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 51/100] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:25.714781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bdedf-f97f-4359-a18e-e3e7dee8d421 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:25.727525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bdedf-f97f-4359-a18e-e3e7dee8d421 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:25.736098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7562-cfbd-4fc3-8287-07b5f0f1bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:25.736969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7562-cfbd-4fc3-8287-07b5f0f1bec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:25.737272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7562-cfbd-4fc3-8287-07b5f0f1bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:25.737553 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d7562-cfbd-4fc3-8287-07b5f0f1bec7 admin admin] PATH_INFO: `/v3/users/2301f411413942aa83ea957b1ac3e10c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:25.742018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d7562-cfbd-4fc3-8287-07b5f0f1bec7 admin admin] RBAC: Authorizing `identity:get_user(user_id=2301f411413942aa83ea957b1ac3e10c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:25.744316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d7562-cfbd-4fc3-8287-07b5f0f1bec7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:25.746232 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 50/101] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:25 2022] GET /identity/v3/users/2301f411413942aa83ea957b1ac3e10c => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:25.751921 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dec6d8-48d9-4fdc-af96-d094f37b9733 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:25.763104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dec6d8-48d9-4fdc-af96-d094f37b9733 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:25.768224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b36de-aebd-4f47-9abe-d1ce7abc8428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:25.769180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b36de-aebd-4f47-9abe-d1ce7abc8428 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:25.769486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b36de-aebd-4f47-9abe-d1ce7abc8428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:25.769758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b36de-aebd-4f47-9abe-d1ce7abc8428 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:25.772225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b36de-aebd-4f47-9abe-d1ce7abc8428 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:25.774449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b36de-aebd-4f47-9abe-d1ce7abc8428 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:25.776177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 52/102] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:25 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:25.782149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7562-cfbd-4fc3-8287-07b5f0f1bec7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:25.792236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d7562-cfbd-4fc3-8287-07b5f0f1bec7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:25.797116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b012c-a7f3-479b-8c3f-d12ed12eddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:25.798135 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b012c-a7f3-479b-8c3f-d12ed12eddc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:25.798417 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b012c-a7f3-479b-8c3f-d12ed12eddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:25.798691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b012c-a7f3-479b-8c3f-d12ed12eddc7 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/users/2301f411413942aa83ea957b1ac3e10c/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:25.800802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b012c-a7f3-479b-8c3f-d12ed12eddc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d55db5bd2549ce81113a761b93b5f7, user_id=2301f411413942aa83ea957b1ac3e10c, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:25.801938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-804b012c-a7f3-479b-8c3f-d12ed12eddc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:25.801938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:12:25.801938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:12:25.803936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b012c-a7f3-479b-8c3f-d12ed12eddc7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:25.820364 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 51/103] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:12:25 2022] PUT /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/users/2301f411413942aa83ea957b1ac3e10c/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:26.370797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbba6f5-1ad0-41a6-99f9-39b56fd9fc5b None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.371175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbba6f5-1ad0-41a6-99f9-39b56fd9fc5b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.371402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbba6f5-1ad0-41a6-99f9-39b56fd9fc5b None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.373740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 53/104] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:26.379185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad768618-9839-4db4-b11f-9df40c8e9300 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.379478 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad768618-9839-4db4-b11f-9df40c8e9300 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.379761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad768618-9839-4db4-b11f-9df40c8e9300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.399815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ad768618-9839-4db4-b11f-9df40c8e9300 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:26.401024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ad768618-9839-4db4-b11f-9df40c8e9300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:26.414477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf506f0-ea8b-4448-83d8-51e9fe572db8 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.414745 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf506f0-ea8b-4448-83d8-51e9fe572db8 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.415023 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf506f0-ea8b-4448-83d8-51e9fe572db8 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.416819 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 54/105] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:12:26.422002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ef71e-cd90-4b9c-bda6-d8b1406333c9 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.422289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ef71e-cd90-4b9c-bda6-d8b1406333c9 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.422570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ef71e-cd90-4b9c-bda6-d8b1406333c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.451256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-127ef71e-cd90-4b9c-bda6-d8b1406333c9 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:26.452478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-127ef71e-cd90-4b9c-bda6-d8b1406333c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:26.504741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 52/106] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:26.531364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 55/107] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:26.549343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad768618-9839-4db4-b11f-9df40c8e9300 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.560100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad768618-9839-4db4-b11f-9df40c8e9300 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.564969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb688d-7b80-445b-b3ca-895dafbabef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.566133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb688d-7b80-445b-b3ca-895dafbabef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.566739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb688d-7b80-445b-b3ca-895dafbabef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.567210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb688d-7b80-445b-b3ca-895dafbabef8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.572117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ef71e-cd90-4b9c-bda6-d8b1406333c9 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.579463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb688d-7b80-445b-b3ca-895dafbabef8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:26.586344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ef71e-cd90-4b9c-bda6-d8b1406333c9 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.587477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ebbb688d-7b80-445b-b3ca-895dafbabef8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:26.589064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 53/108] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:26.594926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb688d-7b80-445b-b3ca-895dafbabef8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.596196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4955c-50c3-4e7d-8222-c387cd4b7768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.597022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4955c-50c3-4e7d-8222-c387cd4b7768 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.597315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4955c-50c3-4e7d-8222-c387cd4b7768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.597589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4955c-50c3-4e7d-8222-c387cd4b7768 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.607618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb688d-7b80-445b-b3ca-895dafbabef8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.614990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200954b7-e0da-404e-ae20-a00802844794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.616048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200954b7-e0da-404e-ae20-a00802844794 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.616531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200954b7-e0da-404e-ae20-a00802844794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.617046 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200954b7-e0da-404e-ae20-a00802844794 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.618105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200954b7-e0da-404e-ae20-a00802844794 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:26.618603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200954b7-e0da-404e-ae20-a00802844794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:26.620532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200954b7-e0da-404e-ae20-a00802844794 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:26.630003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 54/109] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:26.631566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4955c-50c3-4e7d-8222-c387cd4b7768 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:26.638408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200954b7-e0da-404e-ae20-a00802844794 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.638983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-ffd4955c-50c3-4e7d-8222-c387cd4b7768 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:26.640576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 56/110] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:12:26.646584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4955c-50c3-4e7d-8222-c387cd4b7768 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.653774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200954b7-e0da-404e-ae20-a00802844794 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.655627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4955c-50c3-4e7d-8222-c387cd4b7768 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.661916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9473a0-047d-46d1-b594-c6b5c96bb3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.662581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9473a0-047d-46d1-b594-c6b5c96bb3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.662906 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9473a0-047d-46d1-b594-c6b5c96bb3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.663182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9473a0-047d-46d1-b594-c6b5c96bb3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.664099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9473a0-047d-46d1-b594-c6b5c96bb3b1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:26.664448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9473a0-047d-46d1-b594-c6b5c96bb3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:26.665068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d44c6-f751-42a9-baa8-545ba235df07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.666118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9473a0-047d-46d1-b594-c6b5c96bb3b1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:26.666411 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d44c6-f751-42a9-baa8-545ba235df07 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.666886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d44c6-f751-42a9-baa8-545ba235df07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.667355 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d44c6-f751-42a9-baa8-545ba235df07 admin admin] PATH_INFO: `/v3/users/2301f411413942aa83ea957b1ac3e10c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.673655 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d44c6-f751-42a9-baa8-545ba235df07 admin admin] RBAC: Authorizing `identity:get_user(user_id=2301f411413942aa83ea957b1ac3e10c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:26.673655 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d44c6-f751-42a9-baa8-545ba235df07 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:26.679077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 55/111] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/users/2301f411413942aa83ea957b1ac3e10c => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:26.682385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ad04e-e7a6-4a93-afef-8c06fb68adbe None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.682712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ad04e-e7a6-4a93-afef-8c06fb68adbe None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.682983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ad04e-e7a6-4a93-afef-8c06fb68adbe None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.683379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 57/112] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:26.684219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9473a0-047d-46d1-b594-c6b5c96bb3b1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.693343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 56/113] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:26 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:26.696647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1ae7d-25da-40b4-a72c-673b30b13d3a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.696925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1ae7d-25da-40b4-a72c-673b30b13d3a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.697273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1ae7d-25da-40b4-a72c-673b30b13d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.709154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9473a0-047d-46d1-b594-c6b5c96bb3b1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.718185 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927ebf8-c520-4fac-947a-756f051fcc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.720311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ebf8-c520-4fac-947a-756f051fcc1d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.720589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ebf8-c520-4fac-947a-756f051fcc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.722674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ebf8-c520-4fac-947a-756f051fcc1d admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.724802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6ea1ae7d-25da-40b4-a72c-673b30b13d3a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:26.726215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927ebf8-c520-4fac-947a-756f051fcc1d admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:26.727866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6ea1ae7d-25da-40b4-a72c-673b30b13d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:26.729601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927ebf8-c520-4fac-947a-756f051fcc1d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:26.732038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 58/114] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:26.733576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927ebf8-c520-4fac-947a-756f051fcc1d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.744961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 57/115] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:26.745920 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1ae7d-25da-40b4-a72c-673b30b13d3a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.755420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927ebf8-c520-4fac-947a-756f051fcc1d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.763374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd34e7b-d3aa-4357-a093-1254648f400c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.764638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1ae7d-25da-40b4-a72c-673b30b13d3a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.765684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd34e7b-d3aa-4357-a093-1254648f400c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.766318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd34e7b-d3aa-4357-a093-1254648f400c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.766700 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd34e7b-d3aa-4357-a093-1254648f400c admin admin] PATH_INFO: `/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.769116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd34e7b-d3aa-4357-a093-1254648f400c admin admin] RBAC: Authorizing `identity:get_user(user_id=16dd35c2d4174b5ab9f9b2bf626a2af7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:26.772807 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3dd98-ea28-4699-801d-b738a8263593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.773737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd34e7b-d3aa-4357-a093-1254648f400c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:26.775568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3dd98-ea28-4699-801d-b738a8263593 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.775891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3dd98-ea28-4699-801d-b738a8263593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.776162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3dd98-ea28-4699-801d-b738a8263593 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/users/2301f411413942aa83ea957b1ac3e10c/roles/7cc6510c2843471b8db1852425803574` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.778172 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 59/116] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:26.780310 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd34e7b-d3aa-4357-a093-1254648f400c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.781295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3dd98-ea28-4699-801d-b738a8263593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d55db5bd2549ce81113a761b93b5f7, user_id=2301f411413942aa83ea957b1ac3e10c, role_id=7cc6510c2843471b8db1852425803574)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:26.788566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3dd98-ea28-4699-801d-b738a8263593 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:26.796814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd34e7b-d3aa-4357-a093-1254648f400c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.804735 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefba86a-e28e-4d91-8a3d-24d636d9aa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.807511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 58/117] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:12:26 2022] PUT /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/users/2301f411413942aa83ea957b1ac3e10c/roles/7cc6510c2843471b8db1852425803574 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:26.808976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3dd98-ea28-4699-801d-b738a8263593 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.809594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefba86a-e28e-4d91-8a3d-24d636d9aa3d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.809976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefba86a-e28e-4d91-8a3d-24d636d9aa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.810254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefba86a-e28e-4d91-8a3d-24d636d9aa3d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.831828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefba86a-e28e-4d91-8a3d-24d636d9aa3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:26.845635 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-cefba86a-e28e-4d91-8a3d-24d636d9aa3d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:26.850634 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 60/118] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:26.855056 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefba86a-e28e-4d91-8a3d-24d636d9aa3d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.872615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefba86a-e28e-4d91-8a3d-24d636d9aa3d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.927629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3dd98-ea28-4699-801d-b738a8263593 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.939487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3e51-7296-4677-869d-d238499141bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.941346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3e51-7296-4677-869d-d238499141bf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.942230 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e117d-0fed-458a-a03a-ee652996b311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.943120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e117d-0fed-458a-a03a-ee652996b311 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.943616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3e51-7296-4677-869d-d238499141bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.944087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c3e51-7296-4677-869d-d238499141bf admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.945141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e117d-0fed-458a-a03a-ee652996b311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.945634 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e117d-0fed-458a-a03a-ee652996b311 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.946476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c3e51-7296-4677-869d-d238499141bf admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:26.947465 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e117d-0fed-458a-a03a-ee652996b311 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:26.949795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c3e51-7296-4677-869d-d238499141bf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:26.950364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e117d-0fed-458a-a03a-ee652996b311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:26.952144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e117d-0fed-458a-a03a-ee652996b311 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:26.954112 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 59/119] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:26.960127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3e51-7296-4677-869d-d238499141bf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.970292 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 61/120] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:26.971712 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e117d-0fed-458a-a03a-ee652996b311 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:26.972616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c3e51-7296-4677-869d-d238499141bf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.984794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e117d-0fed-458a-a03a-ee652996b311 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:26.987704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15494a2d-e2a7-4620-bb58-50d2b8977192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:26.988620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494a2d-e2a7-4620-bb58-50d2b8977192 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:26.988899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494a2d-e2a7-4620-bb58-50d2b8977192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:26.989177 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15494a2d-e2a7-4620-bb58-50d2b8977192 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/users/16dd35c2d4174b5ab9f9b2bf626a2af7/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:26.991927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15494a2d-e2a7-4620-bb58-50d2b8977192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d55db5bd2549ce81113a761b93b5f7, user_id=16dd35c2d4174b5ab9f9b2bf626a2af7, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:26.995203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15494a2d-e2a7-4620-bb58-50d2b8977192 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:27.000270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf80c6b-3297-4b51-9143-e79f8c4db4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:27.001159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf80c6b-3297-4b51-9143-e79f8c4db4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:27.001461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf80c6b-3297-4b51-9143-e79f8c4db4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:27.001731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf80c6b-3297-4b51-9143-e79f8c4db4c1 admin admin] PATH_INFO: `/v3/users/2301f411413942aa83ea957b1ac3e10c` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:27.004145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf80c6b-3297-4b51-9143-e79f8c4db4c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=2301f411413942aa83ea957b1ac3e10c)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:27.006365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf80c6b-3297-4b51-9143-e79f8c4db4c1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:27.008309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 62/121] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:26 2022] GET /identity/v3/users/2301f411413942aa83ea957b1ac3e10c => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:27.014430 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf80c6b-3297-4b51-9143-e79f8c4db4c1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:27.027429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf80c6b-3297-4b51-9143-e79f8c4db4c1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:27.038217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 60/122] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:12:26 2022] PUT /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/users/16dd35c2d4174b5ab9f9b2bf626a2af7/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:27.112395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076131f-f1dd-4875-88ff-9693af0619df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:27.113322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076131f-f1dd-4875-88ff-9693af0619df admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:27.113605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076131f-f1dd-4875-88ff-9693af0619df admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:27.113929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076131f-f1dd-4875-88ff-9693af0619df admin admin] PATH_INFO: `/v3/projects/99359a7cbed64b758a0c058817fdbf7a` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:27.116784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076131f-f1dd-4875-88ff-9693af0619df admin admin] RBAC: Authorizing `identity:get_project(project_id=99359a7cbed64b758a0c058817fdbf7a)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:27.119005 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076131f-f1dd-4875-88ff-9693af0619df admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:27.121163 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 63/123] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:27 2022] GET /identity/v3/projects/99359a7cbed64b758a0c058817fdbf7a => generated 312 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:27.127155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15494a2d-e2a7-4620-bb58-50d2b8977192 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:27.143449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15494a2d-e2a7-4620-bb58-50d2b8977192 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:27.158111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e41d62-39fb-4c98-8d2e-7c86e0b29146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:27.159043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41d62-39fb-4c98-8d2e-7c86e0b29146 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:27.159327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41d62-39fb-4c98-8d2e-7c86e0b29146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:27.159601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41d62-39fb-4c98-8d2e-7c86e0b29146 admin admin] PATH_INFO: `/v3/projects/99359a7cbed64b758a0c058817fdbf7a/users/2301f411413942aa83ea957b1ac3e10c/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:27.161882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e41d62-39fb-4c98-8d2e-7c86e0b29146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99359a7cbed64b758a0c058817fdbf7a, user_id=2301f411413942aa83ea957b1ac3e10c, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:27.164616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e41d62-39fb-4c98-8d2e-7c86e0b29146 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:27.194748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 61/124] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:12:27 2022] PUT /identity/v3/projects/99359a7cbed64b758a0c058817fdbf7a/users/2301f411413942aa83ea957b1ac3e10c/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:28.147116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2da2c-843e-431f-b549-873f3f4037ad None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.147670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2da2c-843e-431f-b549-873f3f4037ad None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.147670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2da2c-843e-431f-b549-873f3f4037ad None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.149623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 64/125] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:28.154908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2c7d-48c5-4b95-a67b-7f3131196017 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.155335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2c7d-48c5-4b95-a67b-7f3131196017 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.155522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2c7d-48c5-4b95-a67b-7f3131196017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.177310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a90d2c7d-48c5-4b95-a67b-7f3131196017 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:28.178546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a90d2c7d-48c5-4b95-a67b-7f3131196017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:28.211000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e252de-125d-48d8-bfe8-4e0e33e55e8f None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.211299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e252de-125d-48d8-bfe8-4e0e33e55e8f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.211553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e252de-125d-48d8-bfe8-4e0e33e55e8f None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.213474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 65/126] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:12:28.233938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11db363-609d-4f4e-9bfc-3f9c6048b698 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.234232 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11db363-609d-4f4e-9bfc-3f9c6048b698 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.234483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11db363-609d-4f4e-9bfc-3f9c6048b698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.256078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 62/127] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:28.274270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b11db363-609d-4f4e-9bfc-3f9c6048b698 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:28.275456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b11db363-609d-4f4e-9bfc-3f9c6048b698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:28.290793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 66/128] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:28.292505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d2c7d-48c5-4b95-a67b-7f3131196017 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:28.307009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d2c7d-48c5-4b95-a67b-7f3131196017 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:28.316132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60df08-532b-4763-b3be-05730e4bbae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:28.317183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60df08-532b-4763-b3be-05730e4bbae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.317686 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60df08-532b-4763-b3be-05730e4bbae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.318146 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60df08-532b-4763-b3be-05730e4bbae3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.330852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11db363-609d-4f4e-9bfc-3f9c6048b698 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:28.337156 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60df08-532b-4763-b3be-05730e4bbae3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:28.344394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-1d60df08-532b-4763-b3be-05730e4bbae3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 28 01:12:28.344789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11db363-609d-4f4e-9bfc-3f9c6048b698 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:28.346120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 63/129] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:28.352125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60df08-532b-4763-b3be-05730e4bbae3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:28.353493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe43846-b88c-44cf-9a3f-2965afa05072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:28.354299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe43846-b88c-44cf-9a3f-2965afa05072 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.354576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe43846-b88c-44cf-9a3f-2965afa05072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.354846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe43846-b88c-44cf-9a3f-2965afa05072 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.359948 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe43846-b88c-44cf-9a3f-2965afa05072 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:28.361767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe43846-b88c-44cf-9a3f-2965afa05072 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:28.363615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 67/130] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:28.366005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60df08-532b-4763-b3be-05730e4bbae3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:28.369209 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe43846-b88c-44cf-9a3f-2965afa05072 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:28.375227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dbeb2-719c-4dfd-965a-4bcf3197cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:28.375908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dbeb2-719c-4dfd-965a-4bcf3197cafe admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.376195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dbeb2-719c-4dfd-965a-4bcf3197cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.376473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dbeb2-719c-4dfd-965a-4bcf3197cafe admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.380635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dbeb2-719c-4dfd-965a-4bcf3197cafe admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:28.380635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dbeb2-719c-4dfd-965a-4bcf3197cafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:28.380635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dbeb2-719c-4dfd-965a-4bcf3197cafe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:28.391698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe43846-b88c-44cf-9a3f-2965afa05072 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:28.393154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 64/131] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:28.400451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dbeb2-719c-4dfd-965a-4bcf3197cafe admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:28.401201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db183fc-ba1e-45fc-996c-5585ca597241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:28.402076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db183fc-ba1e-45fc-996c-5585ca597241 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.402425 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db183fc-ba1e-45fc-996c-5585ca597241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.402758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db183fc-ba1e-45fc-996c-5585ca597241 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.403627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db183fc-ba1e-45fc-996c-5585ca597241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:28.405648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db183fc-ba1e-45fc-996c-5585ca597241 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:28.414699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dbeb2-719c-4dfd-965a-4bcf3197cafe admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:28.425500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc63d64-977a-45bf-bf8f-50cddbc29fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:28.426635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63d64-977a-45bf-bf8f-50cddbc29fae admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.427536 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63d64-977a-45bf-bf8f-50cddbc29fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.428023 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63d64-977a-45bf-bf8f-50cddbc29fae admin admin] PATH_INFO: `/v3/users/f5ed51971c1c4c829058ce4672b5060a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.451063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc63d64-977a-45bf-bf8f-50cddbc29fae admin admin] RBAC: Authorizing `identity:get_user(user_id=f5ed51971c1c4c829058ce4672b5060a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:28.453635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc63d64-977a-45bf-bf8f-50cddbc29fae admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:28.455587 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 65/132] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:28 2022] GET /identity/v3/users/f5ed51971c1c4c829058ce4672b5060a => generated 289 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:28.461128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc63d64-977a-45bf-bf8f-50cddbc29fae admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:28.465563 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 68/133] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:12:28 2022] POST /identity/v3/projects => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:28.475055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc63d64-977a-45bf-bf8f-50cddbc29fae admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:28.554889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf390ad-512c-4d37-b5b5-c81a5f2e23bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:28.555805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf390ad-512c-4d37-b5b5-c81a5f2e23bd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.556225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf390ad-512c-4d37-b5b5-c81a5f2e23bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.556671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf390ad-512c-4d37-b5b5-c81a5f2e23bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.567459 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf390ad-512c-4d37-b5b5-c81a5f2e23bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:28.569600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf390ad-512c-4d37-b5b5-c81a5f2e23bd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:28.583379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 66/134] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 01:12:28.589580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db183fc-ba1e-45fc-996c-5585ca597241 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:28.614231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db183fc-ba1e-45fc-996c-5585ca597241 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:28.634518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff65de-9205-43c7-bc3c-8f57fe078400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:28.635605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff65de-9205-43c7-bc3c-8f57fe078400 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.636028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff65de-9205-43c7-bc3c-8f57fe078400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.636455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff65de-9205-43c7-bc3c-8f57fe078400 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.638282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff65de-9205-43c7-bc3c-8f57fe078400 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:28.640671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff65de-9205-43c7-bc3c-8f57fe078400 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:28.642767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 69/135] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:28 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:28.648739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf390ad-512c-4d37-b5b5-c81a5f2e23bd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:28.665607 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf390ad-512c-4d37-b5b5-c81a5f2e23bd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:28.674871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b5e74-a7de-4340-a7f6-9e9bbd976461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:28.675610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5e74-a7de-4340-a7f6-9e9bbd976461 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.675895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5e74-a7de-4340-a7f6-9e9bbd976461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.676224 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5e74-a7de-4340-a7f6-9e9bbd976461 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.677143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5e74-a7de-4340-a7f6-9e9bbd976461 admin admin] RBAC: Adding query filter params (role.id=c8891868ea2c4086af4903f6050eecc4, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7, user.id=f5ed51971c1c4c829058ce4672b5060a) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:28.677489 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5e74-a7de-4340-a7f6-9e9bbd976461 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:28.679512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5e74-a7de-4340-a7f6-9e9bbd976461 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:28.690231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 67/136] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:28 2022] GET /identity/v3/role_assignments?user.id=f5ed51971c1c4c829058ce4672b5060a&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=c8891868ea2c4086af4903f6050eecc4 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:28.959713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc33d-0487-45a2-bc21-87acbf0a8cd6 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.960357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc33d-0487-45a2-bc21-87acbf0a8cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.960831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cc33d-0487-45a2-bc21-87acbf0a8cd6 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.962906 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 70/137] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:28.968816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13f515-574f-4779-8aab-7f9d4729f246 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:28.969503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13f515-574f-4779-8aab-7f9d4729f246 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:28.969981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13f515-574f-4779-8aab-7f9d4729f246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:28.990143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2b13f515-574f-4779-8aab-7f9d4729f246 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:28.991697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2b13f515-574f-4779-8aab-7f9d4729f246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:29.000119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 68/138] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:29.024512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cc33d-0487-45a2-bc21-87acbf0a8cd6 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:29.038233 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cc33d-0487-45a2-bc21-87acbf0a8cd6 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:29.044057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607c429-c8fa-484e-84f1-c5d14c18133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:29.045312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607c429-c8fa-484e-84f1-c5d14c18133e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:29.045789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607c429-c8fa-484e-84f1-c5d14c18133e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:29.046272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607c429-c8fa-484e-84f1-c5d14c18133e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:29.061397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607c429-c8fa-484e-84f1-c5d14c18133e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:29.068650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-4607c429-c8fa-484e-84f1-c5d14c18133e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:29.070454 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 71/139] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:29.076199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13f515-574f-4779-8aab-7f9d4729f246 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:29.085712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13f515-574f-4779-8aab-7f9d4729f246 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:29.091295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0c70a-ddb1-4093-a45c-045d19bf4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:29.092225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0c70a-ddb1-4093-a45c-045d19bf4690 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:29.092694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0c70a-ddb1-4093-a45c-045d19bf4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:29.093172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0c70a-ddb1-4093-a45c-045d19bf4690 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:29.094189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0c70a-ddb1-4093-a45c-045d19bf4690 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:29.094680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0c70a-ddb1-4093-a45c-045d19bf4690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:29.096505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0c70a-ddb1-4093-a45c-045d19bf4690 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:29.107545 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 69/140] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:29.112863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607c429-c8fa-484e-84f1-c5d14c18133e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:29.123473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607c429-c8fa-484e-84f1-c5d14c18133e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:29.129626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce22bb-8ed7-41e6-a7c2-abf3d82b3cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:29.130737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce22bb-8ed7-41e6-a7c2-abf3d82b3cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:29.131204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce22bb-8ed7-41e6-a7c2-abf3d82b3cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:29.131734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce22bb-8ed7-41e6-a7c2-abf3d82b3cb8 admin admin] PATH_INFO: `/v3/users/2301f411413942aa83ea957b1ac3e10c` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:29.133614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce22bb-8ed7-41e6-a7c2-abf3d82b3cb8 admin admin] RBAC: Authorizing `identity:get_user(user_id=2301f411413942aa83ea957b1ac3e10c)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:29.136084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce22bb-8ed7-41e6-a7c2-abf3d82b3cb8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:29.138105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 72/141] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:29 2022] GET /identity/v3/users/2301f411413942aa83ea957b1ac3e10c => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:29.143799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0c70a-ddb1-4093-a45c-045d19bf4690 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:29.158333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0c70a-ddb1-4093-a45c-045d19bf4690 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:29.166332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8df486-8fc1-4939-b045-c8e2691e207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:29.167225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8df486-8fc1-4939-b045-c8e2691e207e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:29.167696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8df486-8fc1-4939-b045-c8e2691e207e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:29.168154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8df486-8fc1-4939-b045-c8e2691e207e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:29.180776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8df486-8fc1-4939-b045-c8e2691e207e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:29.182841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8df486-8fc1-4939-b045-c8e2691e207e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:29.193127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 70/142] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:29.199205 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce22bb-8ed7-41e6-a7c2-abf3d82b3cb8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:29.210184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce22bb-8ed7-41e6-a7c2-abf3d82b3cb8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:29.214968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e1b4c-e23d-4a4b-babb-ad768bc2dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:29.216290 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1b4c-e23d-4a4b-babb-ad768bc2dc0f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:29.216786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1b4c-e23d-4a4b-babb-ad768bc2dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:29.217364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e1b4c-e23d-4a4b-babb-ad768bc2dc0f admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:29.218813 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e1b4c-e23d-4a4b-babb-ad768bc2dc0f admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:29.221087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e1b4c-e23d-4a4b-babb-ad768bc2dc0f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:29.223006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 73/143] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:29 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:29.230109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8df486-8fc1-4939-b045-c8e2691e207e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:29.239853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8df486-8fc1-4939-b045-c8e2691e207e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:29.249412 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93ba6c-02fc-44ca-a714-7c737e763b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:29.250323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93ba6c-02fc-44ca-a714-7c737e763b57 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:29.250792 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93ba6c-02fc-44ca-a714-7c737e763b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:29.251247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93ba6c-02fc-44ca-a714-7c737e763b57 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:29.252279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93ba6c-02fc-44ca-a714-7c737e763b57 admin admin] RBAC: Adding query filter params (role.id=726ccf812eba475187c3df7288e1d46b, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7, user.id=2301f411413942aa83ea957b1ac3e10c) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:29.252799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93ba6c-02fc-44ca-a714-7c737e763b57 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:29.254863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93ba6c-02fc-44ca-a714-7c737e763b57 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:29.265855 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 71/144] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:29 2022] GET /identity/v3/role_assignments?user.id=2301f411413942aa83ea957b1ac3e10c&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=726ccf812eba475187c3df7288e1d46b => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:30.091336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e5bdd-4e92-4303-98ff-fa44e00f9c64 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.092052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e5bdd-4e92-4303-98ff-fa44e00f9c64 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.092522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e5bdd-4e92-4303-98ff-fa44e00f9c64 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.094835 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 74/145] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:30.100319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9e0c2-a936-4e7d-b16a-c2f7be5286b0 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.100810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9e0c2-a936-4e7d-b16a-c2f7be5286b0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.101336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9e0c2-a936-4e7d-b16a-c2f7be5286b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.126343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-27f9e0c2-a936-4e7d-b16a-c2f7be5286b0 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:30.127895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-27f9e0c2-a936-4e7d-b16a-c2f7be5286b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:30.136220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 72/146] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:30.180844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e5bdd-4e92-4303-98ff-fa44e00f9c64 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.197558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e5bdd-4e92-4303-98ff-fa44e00f9c64 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.202255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295cff0-db95-4993-8a3b-947e24b30e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.203773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295cff0-db95-4993-8a3b-947e24b30e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.204288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295cff0-db95-4993-8a3b-947e24b30e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.204747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295cff0-db95-4993-8a3b-947e24b30e5b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.218049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295cff0-db95-4993-8a3b-947e24b30e5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:30.225596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-0295cff0-db95-4993-8a3b-947e24b30e5b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:30.227323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 75/147] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:30.232795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9e0c2-a936-4e7d-b16a-c2f7be5286b0 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.242632 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9e0c2-a936-4e7d-b16a-c2f7be5286b0 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.247479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00ac6c-e870-4cb0-b2d1-40177c92e132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.248459 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00ac6c-e870-4cb0-b2d1-40177c92e132 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.248928 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00ac6c-e870-4cb0-b2d1-40177c92e132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.249433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00ac6c-e870-4cb0-b2d1-40177c92e132 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.250450 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00ac6c-e870-4cb0-b2d1-40177c92e132 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:30.250957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00ac6c-e870-4cb0-b2d1-40177c92e132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.252763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00ac6c-e870-4cb0-b2d1-40177c92e132 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.261799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 73/148] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:30.267472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295cff0-db95-4993-8a3b-947e24b30e5b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.281472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295cff0-db95-4993-8a3b-947e24b30e5b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.286304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe4d37-2248-4a29-90ba-d88f25e9ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.287439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe4d37-2248-4a29-90ba-d88f25e9ca5b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.287943 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe4d37-2248-4a29-90ba-d88f25e9ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.288420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe4d37-2248-4a29-90ba-d88f25e9ca5b admin admin] PATH_INFO: `/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.289878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe4d37-2248-4a29-90ba-d88f25e9ca5b admin admin] RBAC: Authorizing `identity:get_user(user_id=16dd35c2d4174b5ab9f9b2bf626a2af7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.291891 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe4d37-2248-4a29-90ba-d88f25e9ca5b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.293887 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 76/149] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/users/16dd35c2d4174b5ab9f9b2bf626a2af7 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:30.302647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00ac6c-e870-4cb0-b2d1-40177c92e132 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.312130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec87ade-ab40-4ceb-8a63-df7c1537784f None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.312725 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec87ade-ab40-4ceb-8a63-df7c1537784f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.313210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec87ade-ab40-4ceb-8a63-df7c1537784f None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.314052 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00ac6c-e870-4cb0-b2d1-40177c92e132 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.315646 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 77/150] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:30.323301 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307c5c-12d9-4f0b-8d22-d23da83e0345 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.324324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307c5c-12d9-4f0b-8d22-d23da83e0345 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.324935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17307c5c-12d9-4f0b-8d22-d23da83e0345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.329720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9f564-b4cf-4024-820e-9b47d1389704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.331651 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9f564-b4cf-4024-820e-9b47d1389704 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.332123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9f564-b4cf-4024-820e-9b47d1389704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.333053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9f564-b4cf-4024-820e-9b47d1389704 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.351297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9f564-b4cf-4024-820e-9b47d1389704 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.355005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9f564-b4cf-4024-820e-9b47d1389704 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.361475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-17307c5c-12d9-4f0b-8d22-d23da83e0345 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:30.362877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-17307c5c-12d9-4f0b-8d22-d23da83e0345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:30.374415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 74/151] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:30.379374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 78/152] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:30.383797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9f564-b4cf-4024-820e-9b47d1389704 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.397176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9f564-b4cf-4024-820e-9b47d1389704 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.409992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b8a03-915b-4beb-a5a6-d42d536ab93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.410894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b8a03-915b-4beb-a5a6-d42d536ab93e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.411173 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b8a03-915b-4beb-a5a6-d42d536ab93e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.411449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b8a03-915b-4beb-a5a6-d42d536ab93e admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.412871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b8a03-915b-4beb-a5a6-d42d536ab93e admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.415080 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b8a03-915b-4beb-a5a6-d42d536ab93e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.416943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 75/153] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:30.423589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17307c5c-12d9-4f0b-8d22-d23da83e0345 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.424677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b8a03-915b-4beb-a5a6-d42d536ab93e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.435266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b8a03-915b-4beb-a5a6-d42d536ab93e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.441888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17307c5c-12d9-4f0b-8d22-d23da83e0345 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.445565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911bc3a-8d03-45df-be1a-a36c110c9bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.448279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911bc3a-8d03-45df-be1a-a36c110c9bcd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.449380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911bc3a-8d03-45df-be1a-a36c110c9bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.450795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911bc3a-8d03-45df-be1a-a36c110c9bcd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.453587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6a65e-d450-4c94-bf5f-8a1c21b23ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.455584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6a65e-d450-4c94-bf5f-8a1c21b23ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.456086 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6a65e-d450-4c94-bf5f-8a1c21b23ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.457449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6a65e-d450-4c94-bf5f-8a1c21b23ebd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.458536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6a65e-d450-4c94-bf5f-8a1c21b23ebd admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7, user.id=16dd35c2d4174b5ab9f9b2bf626a2af7) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:30.460694 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6a65e-d450-4c94-bf5f-8a1c21b23ebd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.463875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6a65e-d450-4c94-bf5f-8a1c21b23ebd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.476372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 79/154] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/role_assignments?user.id=16dd35c2d4174b5ab9f9b2bf626a2af7&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:30.477044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911bc3a-8d03-45df-be1a-a36c110c9bcd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:30.489039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-7911bc3a-8d03-45df-be1a-a36c110c9bcd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:30.490903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 76/155] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:30.497218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6a65e-d450-4c94-bf5f-8a1c21b23ebd admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.507950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6a65e-d450-4c94-bf5f-8a1c21b23ebd admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.512948 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff3c7e-6b4c-487f-8cf3-6c2cf353c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.513908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff3c7e-6b4c-487f-8cf3-6c2cf353c6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.514378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff3c7e-6b4c-487f-8cf3-6c2cf353c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.514861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff3c7e-6b4c-487f-8cf3-6c2cf353c6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.515860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff3c7e-6b4c-487f-8cf3-6c2cf353c6f2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:30.516351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff3c7e-6b4c-487f-8cf3-6c2cf353c6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.518270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff3c7e-6b4c-487f-8cf3-6c2cf353c6f2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.533607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 80/156] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:30.540269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911bc3a-8d03-45df-be1a-a36c110c9bcd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.560418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911bc3a-8d03-45df-be1a-a36c110c9bcd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.567952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f340f-70fe-451e-9120-88a2f9fbdcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.569879 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f340f-70fe-451e-9120-88a2f9fbdcab admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.570630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f340f-70fe-451e-9120-88a2f9fbdcab admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.571336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f340f-70fe-451e-9120-88a2f9fbdcab admin admin] PATH_INFO: `/v3/users/2301f411413942aa83ea957b1ac3e10c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.578785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f340f-70fe-451e-9120-88a2f9fbdcab admin admin] RBAC: Authorizing `identity:get_user(user_id=2301f411413942aa83ea957b1ac3e10c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.582981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f340f-70fe-451e-9120-88a2f9fbdcab admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.585571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 77/157] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/users/2301f411413942aa83ea957b1ac3e10c => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:30.592078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff3c7e-6b4c-487f-8cf3-6c2cf353c6f2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.610363 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff3c7e-6b4c-487f-8cf3-6c2cf353c6f2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.616307 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a0c4a-96ad-435d-a455-1cd65dd89be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.617746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0c4a-96ad-435d-a455-1cd65dd89be6 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.618409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0c4a-96ad-435d-a455-1cd65dd89be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.619134 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0c4a-96ad-435d-a455-1cd65dd89be6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.635083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a0c4a-96ad-435d-a455-1cd65dd89be6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.637373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a0c4a-96ad-435d-a455-1cd65dd89be6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.651740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 81/158] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:30.657316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f340f-70fe-451e-9120-88a2f9fbdcab admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.669173 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f340f-70fe-451e-9120-88a2f9fbdcab admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.673951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29972b43-1681-4e9b-9b3a-9fd54bd1ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.674825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972b43-1681-4e9b-9b3a-9fd54bd1ca8b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.675101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972b43-1681-4e9b-9b3a-9fd54bd1ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.675371 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972b43-1681-4e9b-9b3a-9fd54bd1ca8b admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.676648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29972b43-1681-4e9b-9b3a-9fd54bd1ca8b admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.678849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29972b43-1681-4e9b-9b3a-9fd54bd1ca8b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.680798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 78/159] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:30.687011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a0c4a-96ad-435d-a455-1cd65dd89be6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.701492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a0c4a-96ad-435d-a455-1cd65dd89be6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.706820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e49391-ddfc-43ce-b8f1-9faeebf9bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.707470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e49391-ddfc-43ce-b8f1-9faeebf9bcbc admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.707746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e49391-ddfc-43ce-b8f1-9faeebf9bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.708016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e49391-ddfc-43ce-b8f1-9faeebf9bcbc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.708868 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e49391-ddfc-43ce-b8f1-9faeebf9bcbc admin admin] RBAC: Adding query filter params (role.id=7cc6510c2843471b8db1852425803574, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7, user.id=2301f411413942aa83ea957b1ac3e10c) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:30.709168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e49391-ddfc-43ce-b8f1-9faeebf9bcbc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.711073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e49391-ddfc-43ce-b8f1-9faeebf9bcbc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.718824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 82/160] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/role_assignments?user.id=2301f411413942aa83ea957b1ac3e10c&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=7cc6510c2843471b8db1852425803574 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:30.794165 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96fc27-ebde-4da5-abc9-f834d8df34c6 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.794504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96fc27-ebde-4da5-abc9-f834d8df34c6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.794716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96fc27-ebde-4da5-abc9-f834d8df34c6 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.796709 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 79/161] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:30.802747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f475-9f67-4b88-922c-09aaf1a43b2d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.803024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f475-9f67-4b88-922c-09aaf1a43b2d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.803303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f475-9f67-4b88-922c-09aaf1a43b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.826271 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4343f475-9f67-4b88-922c-09aaf1a43b2d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:30.827465 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4343f475-9f67-4b88-922c-09aaf1a43b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:30.835475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 83/162] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:30.862300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96fc27-ebde-4da5-abc9-f834d8df34c6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.880167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96fc27-ebde-4da5-abc9-f834d8df34c6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.885117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be21e9-98f0-40ed-bbc8-8780462134e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.886056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be21e9-98f0-40ed-bbc8-8780462134e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.886389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be21e9-98f0-40ed-bbc8-8780462134e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.886664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be21e9-98f0-40ed-bbc8-8780462134e2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.902769 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be21e9-98f0-40ed-bbc8-8780462134e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:30.910010 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-b5be21e9-98f0-40ed-bbc8-8780462134e2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:30.911815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 80/163] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:30.917975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343f475-9f67-4b88-922c-09aaf1a43b2d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.928252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343f475-9f67-4b88-922c-09aaf1a43b2d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.933437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022ed2f-3109-48bc-aedb-36c6f1968cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.934408 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ed2f-3109-48bc-aedb-36c6f1968cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.934900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ed2f-3109-48bc-aedb-36c6f1968cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.935306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ed2f-3109-48bc-aedb-36c6f1968cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.936218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022ed2f-3109-48bc-aedb-36c6f1968cd7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:30.936684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022ed2f-3109-48bc-aedb-36c6f1968cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.938379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022ed2f-3109-48bc-aedb-36c6f1968cd7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.948325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 84/164] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:30.954338 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be21e9-98f0-40ed-bbc8-8780462134e2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.964787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be21e9-98f0-40ed-bbc8-8780462134e2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:30.969383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb5ee7-aebd-46ab-aa34-3e49de32ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:30.970244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb5ee7-aebd-46ab-aa34-3e49de32ff4e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:30.970516 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb5ee7-aebd-46ab-aa34-3e49de32ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:30.970780 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb5ee7-aebd-46ab-aa34-3e49de32ff4e admin admin] PATH_INFO: `/v3/users/2301f411413942aa83ea957b1ac3e10c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:30.972061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb5ee7-aebd-46ab-aa34-3e49de32ff4e admin admin] RBAC: Authorizing `identity:get_user(user_id=2301f411413942aa83ea957b1ac3e10c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:30.974572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb5ee7-aebd-46ab-aa34-3e49de32ff4e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:30.976469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 81/165] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/users/2301f411413942aa83ea957b1ac3e10c => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:30.986836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022ed2f-3109-48bc-aedb-36c6f1968cd7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:30.999707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022ed2f-3109-48bc-aedb-36c6f1968cd7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:31.004721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9b1d-c2ce-422d-bf5c-fd17da4be058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:31.005928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9b1d-c2ce-422d-bf5c-fd17da4be058 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.006510 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9b1d-c2ce-422d-bf5c-fd17da4be058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.007089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9b1d-c2ce-422d-bf5c-fd17da4be058 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.018050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a9b1d-c2ce-422d-bf5c-fd17da4be058 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:31.019908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a9b1d-c2ce-422d-bf5c-fd17da4be058 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:31.032374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 85/166] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:31.038175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb5ee7-aebd-46ab-aa34-3e49de32ff4e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:31.051762 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb5ee7-aebd-46ab-aa34-3e49de32ff4e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:31.056275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018d902-eb39-4203-b9c3-039708c8ef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:31.057220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018d902-eb39-4203-b9c3-039708c8ef3b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.057593 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018d902-eb39-4203-b9c3-039708c8ef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.057931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018d902-eb39-4203-b9c3-039708c8ef3b admin admin] PATH_INFO: `/v3/projects/99359a7cbed64b758a0c058817fdbf7a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.059228 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018d902-eb39-4203-b9c3-039708c8ef3b admin admin] RBAC: Authorizing `identity:get_project(project_id=99359a7cbed64b758a0c058817fdbf7a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:31.061445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018d902-eb39-4203-b9c3-039708c8ef3b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:31.063546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 82/167] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:31 2022] GET /identity/v3/projects/99359a7cbed64b758a0c058817fdbf7a => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:31.069448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9b1d-c2ce-422d-bf5c-fd17da4be058 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:31.079023 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9b1d-c2ce-422d-bf5c-fd17da4be058 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:31.083685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6ee8f-dc44-4a4b-af52-ea23924e7559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:31.084337 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ee8f-dc44-4a4b-af52-ea23924e7559 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.084622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ee8f-dc44-4a4b-af52-ea23924e7559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.084897 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ee8f-dc44-4a4b-af52-ea23924e7559 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.085817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6ee8f-dc44-4a4b-af52-ea23924e7559 admin admin] RBAC: Adding query filter params (role.id=726ccf812eba475187c3df7288e1d46b, scope.project.id=99359a7cbed64b758a0c058817fdbf7a, user.id=2301f411413942aa83ea957b1ac3e10c) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:31.086096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6ee8f-dc44-4a4b-af52-ea23924e7559 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:31.087973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6ee8f-dc44-4a4b-af52-ea23924e7559 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:31.094807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:31 2022] GET /identity/v3/role_assignments?user.id=2301f411413942aa83ea957b1ac3e10c&scope.project.id=99359a7cbed64b758a0c058817fdbf7a&role.id=726ccf812eba475187c3df7288e1d46b => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:31.610391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad560-c7b8-4345-af0d-fe3f4d8e6d2f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.610906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad560-c7b8-4345-af0d-fe3f4d8e6d2f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.610906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cad560-c7b8-4345-af0d-fe3f4d8e6d2f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.612712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 83/169] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:31.619576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe716d-b901-49be-9fd5-6af0bda125df None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.620095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe716d-b901-49be-9fd5-6af0bda125df None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.620095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe716d-b901-49be-9fd5-6af0bda125df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.623137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7a7c6-f152-4457-a2cb-015382bd4759 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.623427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7a7c6-f152-4457-a2cb-015382bd4759 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.623667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7a7c6-f152-4457-a2cb-015382bd4759 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.625468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 84/170] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:31.631019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0058b-e78f-431a-98ca-8a6cb9d8733e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.631299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0058b-e78f-431a-98ca-8a6cb9d8733e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.631570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0058b-e78f-431a-98ca-8a6cb9d8733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.640076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1fbe716d-b901-49be-9fd5-6af0bda125df None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:31.641268 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1fbe716d-b901-49be-9fd5-6af0bda125df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:31.648884 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 87/171] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:31.650083 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-50d0058b-e78f-431a-98ca-8a6cb9d8733e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:31.651247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-50d0058b-e78f-431a-98ca-8a6cb9d8733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:31.659482 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 85/172] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:31.671475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe716d-b901-49be-9fd5-6af0bda125df None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:31.680308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe716d-b901-49be-9fd5-6af0bda125df None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:31.683552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0058b-e78f-431a-98ca-8a6cb9d8733e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:31.685589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629c43-151c-4fc3-a107-c7ce95b1ba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:31.686391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629c43-151c-4fc3-a107-c7ce95b1ba1d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.686661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629c43-151c-4fc3-a107-c7ce95b1ba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.686924 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629c43-151c-4fc3-a107-c7ce95b1ba1d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.693250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0058b-e78f-431a-98ca-8a6cb9d8733e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:31.699051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea629c43-151c-4fc3-a107-c7ce95b1ba1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:31.699181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342913-b123-4ff3-b47c-ea9684dcb97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:31.699806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342913-b123-4ff3-b47c-ea9684dcb97d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.700105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342913-b123-4ff3-b47c-ea9684dcb97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.700437 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3342913-b123-4ff3-b47c-ea9684dcb97d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.701763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3342913-b123-4ff3-b47c-ea9684dcb97d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:31.703466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3342913-b123-4ff3-b47c-ea9684dcb97d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:31.705039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 86/173] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:31.706057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-ea629c43-151c-4fc3-a107-c7ce95b1ba1d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 28 01:12:31.707226 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 88/174] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:31.710420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342913-b123-4ff3-b47c-ea9684dcb97d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:31.712624 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629c43-151c-4fc3-a107-c7ce95b1ba1d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:31.720230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3342913-b123-4ff3-b47c-ea9684dcb97d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:31.721718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629c43-151c-4fc3-a107-c7ce95b1ba1d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:31.725145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e52c1-d03d-4b23-9011-60ec203de289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:31.725786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e52c1-d03d-4b23-9011-60ec203de289 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.726064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e52c1-d03d-4b23-9011-60ec203de289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.726330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e52c1-d03d-4b23-9011-60ec203de289 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.726415 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3afaf-5b2c-4fda-b6d0-1846ed6e6a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:31.726986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3afaf-5b2c-4fda-b6d0-1846ed6e6a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.727080 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e52c1-d03d-4b23-9011-60ec203de289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:31.727259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3afaf-5b2c-4fda-b6d0-1846ed6e6a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.727525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3afaf-5b2c-4fda-b6d0-1846ed6e6a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.728269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3afaf-5b2c-4fda-b6d0-1846ed6e6a77 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:31.728566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3afaf-5b2c-4fda-b6d0-1846ed6e6a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:31.728880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e52c1-d03d-4b23-9011-60ec203de289 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:31.730177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3afaf-5b2c-4fda-b6d0-1846ed6e6a77 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:31.738749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 89/175] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:31.744089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3afaf-5b2c-4fda-b6d0-1846ed6e6a77 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:31.748811 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 87/176] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:12:31 2022] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:31.753454 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3afaf-5b2c-4fda-b6d0-1846ed6e6a77 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:31.757583 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cca509-c82b-4971-9a15-85f6c699b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:31.758469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca509-c82b-4971-9a15-85f6c699b4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.758743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca509-c82b-4971-9a15-85f6c699b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.759007 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca509-c82b-4971-9a15-85f6c699b4d9 admin admin] PATH_INFO: `/v3/users/f5ed51971c1c4c829058ce4672b5060a` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.760264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cca509-c82b-4971-9a15-85f6c699b4d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=f5ed51971c1c4c829058ce4672b5060a)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:31.762479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cca509-c82b-4971-9a15-85f6c699b4d9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:31.764533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 90/177] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:31 2022] GET /identity/v3/users/f5ed51971c1c4c829058ce4672b5060a => generated 289 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:31.770314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e52c1-d03d-4b23-9011-60ec203de289 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:31.780936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e52c1-d03d-4b23-9011-60ec203de289 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:31.785954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63749851-29cd-49b9-b36d-e45c54be4fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:31.786841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63749851-29cd-49b9-b36d-e45c54be4fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.787128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63749851-29cd-49b9-b36d-e45c54be4fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.787420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63749851-29cd-49b9-b36d-e45c54be4fcd admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.788670 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63749851-29cd-49b9-b36d-e45c54be4fcd admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:31.790794 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63749851-29cd-49b9-b36d-e45c54be4fcd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:31.792719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 88/178] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:31 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:31.798531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cca509-c82b-4971-9a15-85f6c699b4d9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:31.808794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cca509-c82b-4971-9a15-85f6c699b4d9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:31.813485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1e4d1-5d8e-41f5-8862-c7753a3c26e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:31.814413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e4d1-5d8e-41f5-8862-c7753a3c26e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:31.814681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e4d1-5d8e-41f5-8862-c7753a3c26e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:31.814949 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1e4d1-5d8e-41f5-8862-c7753a3c26e2 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/users/f5ed51971c1c4c829058ce4672b5060a/roles/c8891868ea2c4086af4903f6050eecc4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:31.816963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1e4d1-5d8e-41f5-8862-c7753a3c26e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d55db5bd2549ce81113a761b93b5f7, user_id=f5ed51971c1c4c829058ce4672b5060a, role_id=c8891868ea2c4086af4903f6050eecc4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:31.819740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1e4d1-5d8e-41f5-8862-c7753a3c26e2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:31.834564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 91/179] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:12:31 2022] PUT /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/users/f5ed51971c1c4c829058ce4672b5060a/roles/c8891868ea2c4086af4903f6050eecc4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:34.044469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1e8ca-2e23-4448-a32f-692becad61bc None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.045019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1e8ca-2e23-4448-a32f-692becad61bc None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.045309 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1e8ca-2e23-4448-a32f-692becad61bc None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.047270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 89/180] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:34.052958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61902d2b-8726-40f1-8131-7c96a3f34151 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.053430 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61902d2b-8726-40f1-8131-7c96a3f34151 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.053733 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61902d2b-8726-40f1-8131-7c96a3f34151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.071821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-61902d2b-8726-40f1-8131-7c96a3f34151 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:34.073013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-61902d2b-8726-40f1-8131-7c96a3f34151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:34.131275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 92/181] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:34.154816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1e8ca-2e23-4448-a32f-692becad61bc None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.162128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f3e9c-e547-4e65-b2dc-b823cca5f970 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.162414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f3e9c-e547-4e65-b2dc-b823cca5f970 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.162689 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f3e9c-e547-4e65-b2dc-b823cca5f970 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.164511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 93/182] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:34.167407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1e8ca-2e23-4448-a32f-692becad61bc None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.170080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f87b4-6d00-4295-a629-fcb325fc718e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.170613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f87b4-6d00-4295-a629-fcb325fc718e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.171114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f87b4-6d00-4295-a629-fcb325fc718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.171809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a09f63-0bfc-4da0-9d17-73071e9c54a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.172592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a09f63-0bfc-4da0-9d17-73071e9c54a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.172966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a09f63-0bfc-4da0-9d17-73071e9c54a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.173266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a09f63-0bfc-4da0-9d17-73071e9c54a1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.185968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a09f63-0bfc-4da0-9d17-73071e9c54a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:34.189564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-de6f87b4-6d00-4295-a629-fcb325fc718e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:34.191366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-de6f87b4-6d00-4295-a629-fcb325fc718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:34.192976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-99a09f63-0bfc-4da0-9d17-73071e9c54a1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 28 01:12:34.194357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 90/183] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:34.196298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345d039-fe59-4a5c-8d86-bca93caf0e57 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.196595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345d039-fe59-4a5c-8d86-bca93caf0e57 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.196871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345d039-fe59-4a5c-8d86-bca93caf0e57 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.198747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 91/184] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:34.199189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 94/185] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:34.199952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e217175-8f50-4364-a8ad-5d419a098f39 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.200276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e217175-8f50-4364-a8ad-5d419a098f39 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.200548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e217175-8f50-4364-a8ad-5d419a098f39 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.202141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f87b4-6d00-4295-a629-fcb325fc718e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.202245 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 92/186] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:34.204840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b014ae-a377-4fdf-90ad-96674ed3072e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.205123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b014ae-a377-4fdf-90ad-96674ed3072e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.205425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b014ae-a377-4fdf-90ad-96674ed3072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.214749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f87b4-6d00-4295-a629-fcb325fc718e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.219173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f32409-6f74-4b3f-97c2-4dcfd27809ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.219828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32409-6f74-4b3f-97c2-4dcfd27809ae admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.220107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32409-6f74-4b3f-97c2-4dcfd27809ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.220400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32409-6f74-4b3f-97c2-4dcfd27809ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.221210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f32409-6f74-4b3f-97c2-4dcfd27809ae admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:34.221593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f32409-6f74-4b3f-97c2-4dcfd27809ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.223276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f32409-6f74-4b3f-97c2-4dcfd27809ae admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.224468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-53b014ae-a377-4fdf-90ad-96674ed3072e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:34.225710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-53b014ae-a377-4fdf-90ad-96674ed3072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:34.231955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 95/187] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.233369 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a48dc-2764-4d70-8c06-5324ba06f6ee None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.233555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 93/188] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:34.233885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a48dc-2764-4d70-8c06-5324ba06f6ee None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.234162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a48dc-2764-4d70-8c06-5324ba06f6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.238086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b014ae-a377-4fdf-90ad-96674ed3072e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.247131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b014ae-a377-4fdf-90ad-96674ed3072e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.251417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d06a48dc-2764-4d70-8c06-5324ba06f6ee None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:34.252573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d06a48dc-2764-4d70-8c06-5324ba06f6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:34.253575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4a455-4518-4723-9cca-d0007467c626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.254328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a455-4518-4723-9cca-d0007467c626 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.254631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a455-4518-4723-9cca-d0007467c626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.254876 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a455-4518-4723-9cca-d0007467c626 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.260381 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 96/189] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:34.261140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a48dc-2764-4d70-8c06-5324ba06f6ee None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.265441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4a455-4518-4723-9cca-d0007467c626 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:34.269878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a48dc-2764-4d70-8c06-5324ba06f6ee None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.272219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-cca4a455-4518-4723-9cca-d0007467c626 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:34.273576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 94/190] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:34.274180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4a455-4518-4723-9cca-d0007467c626 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.278905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa9655-9fd4-4938-9be9-902d02cc926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.279768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa9655-9fd4-4938-9be9-902d02cc926d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.280041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa9655-9fd4-4938-9be9-902d02cc926d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.280313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa9655-9fd4-4938-9be9-902d02cc926d admin admin] PATH_INFO: `/v3/users/f5ed51971c1c4c829058ce4672b5060a` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.281555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa9655-9fd4-4938-9be9-902d02cc926d admin admin] RBAC: Authorizing `identity:get_user(user_id=f5ed51971c1c4c829058ce4672b5060a)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.283342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4a455-4518-4723-9cca-d0007467c626 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.283779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa9655-9fd4-4938-9be9-902d02cc926d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.285362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 97/191] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/users/f5ed51971c1c4c829058ce4672b5060a => generated 289 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.286526 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa9655-9fd4-4938-9be9-902d02cc926d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.289013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f170-5155-495b-8757-d013c88d32f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.289806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f170-5155-495b-8757-d013c88d32f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.290081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f170-5155-495b-8757-d013c88d32f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.290351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35f170-5155-495b-8757-d013c88d32f1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.296497 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa9655-9fd4-4938-9be9-902d02cc926d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.300518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0055-411d-4317-8cd7-1ce603f1dc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.301179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0055-411d-4317-8cd7-1ce603f1dc40 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.301310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35f170-5155-495b-8757-d013c88d32f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:34.301493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0055-411d-4317-8cd7-1ce603f1dc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.301761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0055-411d-4317-8cd7-1ce603f1dc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.302500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0055-411d-4317-8cd7-1ce603f1dc40 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:34.302798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0055-411d-4317-8cd7-1ce603f1dc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.304341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0055-411d-4317-8cd7-1ce603f1dc40 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.308313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0d35f170-5155-495b-8757-d013c88d32f1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:34.309598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 95/192] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:34.310298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f170-5155-495b-8757-d013c88d32f1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.316476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 98/193] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.317281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0055-411d-4317-8cd7-1ce603f1dc40 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.320275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35f170-5155-495b-8757-d013c88d32f1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.324483 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdee8d-11c2-41d1-bee3-9985d2181e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.325381 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdee8d-11c2-41d1-bee3-9985d2181e65 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.325661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdee8d-11c2-41d1-bee3-9985d2181e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.325932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdee8d-11c2-41d1-bee3-9985d2181e65 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.326071 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0055-411d-4317-8cd7-1ce603f1dc40 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.327088 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdee8d-11c2-41d1-bee3-9985d2181e65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.328759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdee8d-11c2-41d1-bee3-9985d2181e65 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.330228 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325938a-5459-44fb-a7e3-eddf40dd0cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.330373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 96/194] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.331087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdee8d-11c2-41d1-bee3-9985d2181e65 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.333722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325938a-5459-44fb-a7e3-eddf40dd0cac admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.334008 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325938a-5459-44fb-a7e3-eddf40dd0cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.334283 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325938a-5459-44fb-a7e3-eddf40dd0cac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.340206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdee8d-11c2-41d1-bee3-9985d2181e65 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.342165 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325938a-5459-44fb-a7e3-eddf40dd0cac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.343980 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325938a-5459-44fb-a7e3-eddf40dd0cac admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.344515 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64f4b-99cf-4502-961e-f41d6ab75ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.345112 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64f4b-99cf-4502-961e-f41d6ab75ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.345424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64f4b-99cf-4502-961e-f41d6ab75ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.345692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca64f4b-99cf-4502-961e-f41d6ab75ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.346427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca64f4b-99cf-4502-961e-f41d6ab75ad7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:34.346724 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca64f4b-99cf-4502-961e-f41d6ab75ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.348209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca64f4b-99cf-4502-961e-f41d6ab75ad7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.353965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 99/195] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:34.354723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325938a-5459-44fb-a7e3-eddf40dd0cac admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.361867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 97/196] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.361867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64f4b-99cf-4502-961e-f41d6ab75ad7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.363258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325938a-5459-44fb-a7e3-eddf40dd0cac admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.366863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca64f4b-99cf-4502-961e-f41d6ab75ad7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.367402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa2086-29e2-4750-ad3e-e4194b0a36f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.368229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa2086-29e2-4750-ad3e-e4194b0a36f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.368502 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa2086-29e2-4750-ad3e-e4194b0a36f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.368764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa2086-29e2-4750-ad3e-e4194b0a36f2 admin admin] PATH_INFO: `/v3/users/8bc3c2709c8449d2a20aad604f58978b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.371009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89a6c8-60d8-4aef-8fa2-e6e4a1b949db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.371621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89a6c8-60d8-4aef-8fa2-e6e4a1b949db admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.371932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89a6c8-60d8-4aef-8fa2-e6e4a1b949db admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.372239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89a6c8-60d8-4aef-8fa2-e6e4a1b949db admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.372948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89a6c8-60d8-4aef-8fa2-e6e4a1b949db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.374850 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89a6c8-60d8-4aef-8fa2-e6e4a1b949db admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.381899 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa2086-29e2-4750-ad3e-e4194b0a36f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=8bc3c2709c8449d2a20aad604f58978b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.384016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa2086-29e2-4750-ad3e-e4194b0a36f2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.385679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 100/197] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/users/8bc3c2709c8449d2a20aad604f58978b => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.390116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa2086-29e2-4750-ad3e-e4194b0a36f2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.395135 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 98/198] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:12:34 2022] POST /identity/v3/users => generated 297 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:34.399588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa2086-29e2-4750-ad3e-e4194b0a36f2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.402332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89a6c8-60d8-4aef-8fa2-e6e4a1b949db admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.404115 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec85a-7577-4507-961e-8a26916f5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.405013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec85a-7577-4507-961e-8a26916f5d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.405328 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec85a-7577-4507-961e-8a26916f5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.405601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ec85a-7577-4507-961e-8a26916f5d0d admin admin] PATH_INFO: `/v3/users/8bc3c2709c8449d2a20aad604f58978b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.406858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ec85a-7577-4507-961e-8a26916f5d0d admin admin] RBAC: Authorizing `identity:get_user(user_id=8bc3c2709c8449d2a20aad604f58978b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.409037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ec85a-7577-4507-961e-8a26916f5d0d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.410846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 101/199] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/users/8bc3c2709c8449d2a20aad604f58978b => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.415756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec85a-7577-4507-961e-8a26916f5d0d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.418070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89a6c8-60d8-4aef-8fa2-e6e4a1b949db admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.421852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ec85a-7577-4507-961e-8a26916f5d0d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.422783 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8c89e-f412-46fd-9b37-a6686c0d962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.423669 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8c89e-f412-46fd-9b37-a6686c0d962c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.423943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8c89e-f412-46fd-9b37-a6686c0d962c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.424207 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8c89e-f412-46fd-9b37-a6686c0d962c admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.425472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8c89e-f412-46fd-9b37-a6686c0d962c admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.426782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecb69c-d605-4eda-98e8-c5f42ac55c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.427451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecb69c-d605-4eda-98e8-c5f42ac55c6a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.427552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8c89e-f412-46fd-9b37-a6686c0d962c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.427723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecb69c-d605-4eda-98e8-c5f42ac55c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.427994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecb69c-d605-4eda-98e8-c5f42ac55c6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.429310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 99/200] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.430166 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8c89e-f412-46fd-9b37-a6686c0d962c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.436771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecb69c-d605-4eda-98e8-c5f42ac55c6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.438602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecb69c-d605-4eda-98e8-c5f42ac55c6a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.439781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8c89e-f412-46fd-9b37-a6686c0d962c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.445493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173316a5-3895-43c5-8340-b6ba3c628ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.446195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173316a5-3895-43c5-8340-b6ba3c628ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.446472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173316a5-3895-43c5-8340-b6ba3c628ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.447077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173316a5-3895-43c5-8340-b6ba3c628ec7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.449044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 102/201] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:34.454522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecb69c-d605-4eda-98e8-c5f42ac55c6a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.457315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173316a5-3895-43c5-8340-b6ba3c628ec7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.459111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173316a5-3895-43c5-8340-b6ba3c628ec7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.464393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecb69c-d605-4eda-98e8-c5f42ac55c6a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.469304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec95ee-9048-4a4e-9cad-4afdf5ff6c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.469977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 100/202] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:34.470128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec95ee-9048-4a4e-9cad-4afdf5ff6c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.470218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec95ee-9048-4a4e-9cad-4afdf5ff6c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.470484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec95ee-9048-4a4e-9cad-4afdf5ff6c1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.471340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec95ee-9048-4a4e-9cad-4afdf5ff6c1f admin admin] RBAC: Adding query filter params (role.id=c8891868ea2c4086af4903f6050eecc4, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7, user.id=f5ed51971c1c4c829058ce4672b5060a) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:34.471644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec95ee-9048-4a4e-9cad-4afdf5ff6c1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.473938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec95ee-9048-4a4e-9cad-4afdf5ff6c1f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.475798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173316a5-3895-43c5-8340-b6ba3c628ec7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.480903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 103/203] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/role_assignments?user.id=f5ed51971c1c4c829058ce4672b5060a&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=c8891868ea2c4086af4903f6050eecc4 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.486080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec95ee-9048-4a4e-9cad-4afdf5ff6c1f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.494613 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173316a5-3895-43c5-8340-b6ba3c628ec7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.500028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec95ee-9048-4a4e-9cad-4afdf5ff6c1f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.501675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1616d-cb68-4501-afc6-69f5c09ba26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.502801 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1616d-cb68-4501-afc6-69f5c09ba26e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.503263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1616d-cb68-4501-afc6-69f5c09ba26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.503637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1616d-cb68-4501-afc6-69f5c09ba26e admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.505159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1616d-cb68-4501-afc6-69f5c09ba26e admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.506285 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334dc19-6678-4800-86ae-405ab8e071b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.507494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334dc19-6678-4800-86ae-405ab8e071b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.507722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1616d-cb68-4501-afc6-69f5c09ba26e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.508067 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334dc19-6678-4800-86ae-405ab8e071b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.508533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334dc19-6678-4800-86ae-405ab8e071b7 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.510315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 101/204] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.510735 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334dc19-6678-4800-86ae-405ab8e071b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.513399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334dc19-6678-4800-86ae-405ab8e071b7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.515700 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 104/205] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.517503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1616d-cb68-4501-afc6-69f5c09ba26e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.522282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334dc19-6678-4800-86ae-405ab8e071b7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:34.527336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1616d-cb68-4501-afc6-69f5c09ba26e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.533568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a872838-68c5-4648-b38a-413948397212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.533995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334dc19-6678-4800-86ae-405ab8e071b7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:34.534549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a872838-68c5-4648-b38a-413948397212 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.534924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a872838-68c5-4648-b38a-413948397212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.535339 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a872838-68c5-4648-b38a-413948397212 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.536490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a872838-68c5-4648-b38a-413948397212 admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab, user.id=8bc3c2709c8449d2a20aad604f58978b) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:34.537081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a872838-68c5-4648-b38a-413948397212 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.538687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bfc44-6a24-4ed1-86cd-bb0d3d0dd90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:34.539365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bfc44-6a24-4ed1-86cd-bb0d3d0dd90a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:34.539619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a872838-68c5-4648-b38a-413948397212 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.539709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bfc44-6a24-4ed1-86cd-bb0d3d0dd90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:34.539893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bfc44-6a24-4ed1-86cd-bb0d3d0dd90a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:34.540777 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bfc44-6a24-4ed1-86cd-bb0d3d0dd90a admin admin] RBAC: Adding query filter params (role.id=7cc6510c2843471b8db1852425803574, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab, user.id=8bc3c2709c8449d2a20aad604f58978b) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:34.541085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bfc44-6a24-4ed1-86cd-bb0d3d0dd90a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:34.543461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bfc44-6a24-4ed1-86cd-bb0d3d0dd90a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:34.547719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 102/206] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/role_assignments?user.id=8bc3c2709c8449d2a20aad604f58978b&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:34.553347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 105/207] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:34 2022] GET /identity/v3/role_assignments?user.id=8bc3c2709c8449d2a20aad604f58978b&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=7cc6510c2843471b8db1852425803574 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:36.771052 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf491cf-adca-45b7-a74f-fdb64965e994 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.771567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf491cf-adca-45b7-a74f-fdb64965e994 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.771837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf491cf-adca-45b7-a74f-fdb64965e994 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.774040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 103/208] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:36.779711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438fb3-9ef4-44f9-8808-bc55865a5ecf None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.780146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438fb3-9ef4-44f9-8808-bc55865a5ecf None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.780480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438fb3-9ef4-44f9-8808-bc55865a5ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.781542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc609ef-d144-4d0a-be50-d843e915a5fb None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.781956 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc609ef-d144-4d0a-be50-d843e915a5fb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.782359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc609ef-d144-4d0a-be50-d843e915a5fb None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.784173 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 104/209] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:12:36.789071 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad650c17-8c61-4549-a5ae-ec103726bdc0 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.789399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad650c17-8c61-4549-a5ae-ec103726bdc0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.789674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad650c17-8c61-4549-a5ae-ec103726bdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.800166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-05438fb3-9ef4-44f9-8808-bc55865a5ecf None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:36.801718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-05438fb3-9ef4-44f9-8808-bc55865a5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:36.808200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ad650c17-8c61-4549-a5ae-ec103726bdc0 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:36.809642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ad650c17-8c61-4549-a5ae-ec103726bdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:36.810784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 106/210] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:36.819331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 105/211] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:36.834832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05438fb3-9ef4-44f9-8808-bc55865a5ecf None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:36.842611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad650c17-8c61-4549-a5ae-ec103726bdc0 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:36.844128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05438fb3-9ef4-44f9-8808-bc55865a5ecf None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:36.849605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf17302-8a69-4663-917e-9948564fecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:36.850410 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf17302-8a69-4663-917e-9948564fecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.850689 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf17302-8a69-4663-917e-9948564fecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.851012 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf17302-8a69-4663-917e-9948564fecd2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.853401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad650c17-8c61-4549-a5ae-ec103726bdc0 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:36.857784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a108-266a-453f-a73e-71113d6f5045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:36.858579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a108-266a-453f-a73e-71113d6f5045 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.858853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a108-266a-453f-a73e-71113d6f5045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.859180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6a108-266a-453f-a73e-71113d6f5045 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.866173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf17302-8a69-4663-917e-9948564fecd2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:36.869916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6a108-266a-453f-a73e-71113d6f5045 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:36.873098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-0cf17302-8a69-4663-917e-9948564fecd2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:36.874350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 107/212] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:36.879482 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe610de-5714-4b3c-8d94-fc2693a7091c None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.879482 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe610de-5714-4b3c-8d94-fc2693a7091c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.879482 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe610de-5714-4b3c-8d94-fc2693a7091c None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.879771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-cea6a108-266a-453f-a73e-71113d6f5045 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:36.879840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 108/213] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:36.879902 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 106/214] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:36.880435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a108-266a-453f-a73e-71113d6f5045 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:36.881816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228e47-c540-4013-9950-85296c378559 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.882366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228e47-c540-4013-9950-85296c378559 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.882809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228e47-c540-4013-9950-85296c378559 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.884763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 109/215] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:36.885675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7228e47-c540-4013-9950-85296c378559 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:36.895008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6a108-266a-453f-a73e-71113d6f5045 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:36.898996 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7228e47-c540-4013-9950-85296c378559 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:36.899485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8610b1c-3f59-46f8-9916-bfd846126a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:36.900368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610b1c-3f59-46f8-9916-bfd846126a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.900660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610b1c-3f59-46f8-9916-bfd846126a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.900933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8610b1c-3f59-46f8-9916-bfd846126a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.901739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8610b1c-3f59-46f8-9916-bfd846126a9c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:36.902052 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8610b1c-3f59-46f8-9916-bfd846126a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:36.903233 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85647d53-ed6d-4563-9fb9-2832343a2343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:36.903903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647d53-ed6d-4563-9fb9-2832343a2343 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.904175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647d53-ed6d-4563-9fb9-2832343a2343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.904440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647d53-ed6d-4563-9fb9-2832343a2343 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.905147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8610b1c-3f59-46f8-9916-bfd846126a9c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:36.905313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85647d53-ed6d-4563-9fb9-2832343a2343 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:36.905547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85647d53-ed6d-4563-9fb9-2832343a2343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:36.907269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85647d53-ed6d-4563-9fb9-2832343a2343 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:36.916594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 110/216] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:36.916991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 107/217] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:36.917812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be62d70-8278-4eb5-8a79-74eb1a19ba54 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.918082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be62d70-8278-4eb5-8a79-74eb1a19ba54 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.918352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be62d70-8278-4eb5-8a79-74eb1a19ba54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.918935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ae58d-b60b-46b4-9617-210158a56af3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.919430 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ae58d-b60b-46b4-9617-210158a56af3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.919847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ae58d-b60b-46b4-9617-210158a56af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.938066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9be62d70-8278-4eb5-8a79-74eb1a19ba54 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:36.938273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-856ae58d-b60b-46b4-9617-210158a56af3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:36.939222 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9be62d70-8278-4eb5-8a79-74eb1a19ba54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:36.939351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-856ae58d-b60b-46b4-9617-210158a56af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:36.947183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 111/218] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:36.954310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 108/219] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:36.954453 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be62d70-8278-4eb5-8a79-74eb1a19ba54 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:36.954545 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ae58d-b60b-46b4-9617-210158a56af3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:36.963380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ae58d-b60b-46b4-9617-210158a56af3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:36.963686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be62d70-8278-4eb5-8a79-74eb1a19ba54 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:36.968493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6952b64-b0cf-4d59-aa77-8d91ee154533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:36.968810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ab3c-004d-46b6-a1fc-f3c695f598f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:36.969529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6952b64-b0cf-4d59-aa77-8d91ee154533 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.969871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6952b64-b0cf-4d59-aa77-8d91ee154533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.970138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ab3c-004d-46b6-a1fc-f3c695f598f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.970261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6952b64-b0cf-4d59-aa77-8d91ee154533 admin admin] PATH_INFO: `/v3/users/8bc3c2709c8449d2a20aad604f58978b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.970697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ab3c-004d-46b6-a1fc-f3c695f598f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.971103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ab3c-004d-46b6-a1fc-f3c695f598f0 admin admin] PATH_INFO: `/v3/users/517f9a7425d8416b9c51a31152c4e940` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:36.971686 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6952b64-b0cf-4d59-aa77-8d91ee154533 admin admin] RBAC: Authorizing `identity:get_user(user_id=8bc3c2709c8449d2a20aad604f58978b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:36.974214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6952b64-b0cf-4d59-aa77-8d91ee154533 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:36.975810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 109/220] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:36 2022] GET /identity/v3/users/8bc3c2709c8449d2a20aad604f58978b => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:36.976537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6952b64-b0cf-4d59-aa77-8d91ee154533 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:36.986020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6952b64-b0cf-4d59-aa77-8d91ee154533 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:36.986556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9ab3c-004d-46b6-a1fc-f3c695f598f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=517f9a7425d8416b9c51a31152c4e940)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:36.988708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9ab3c-004d-46b6-a1fc-f3c695f598f0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:36.994550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 112/221] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:36 2022] GET /identity/v3/users/517f9a7425d8416b9c51a31152c4e940 => generated 297 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:36.994550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ab3c-004d-46b6-a1fc-f3c695f598f0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:36.995202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9659bcf-cc0d-4d55-946c-8d1ebe37373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:36.995979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659bcf-cc0d-4d55-946c-8d1ebe37373b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:36.996254 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659bcf-cc0d-4d55-946c-8d1ebe37373b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:36.996522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659bcf-cc0d-4d55-946c-8d1ebe37373b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.000487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ab3c-004d-46b6-a1fc-f3c695f598f0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.004757 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a8bd1-37b6-454f-84b1-98cdbac8c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.005546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8bd1-37b6-454f-84b1-98cdbac8c6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.005843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8bd1-37b6-454f-84b1-98cdbac8c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.006110 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8bd1-37b6-454f-84b1-98cdbac8c6ec admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.006579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9659bcf-cc0d-4d55-946c-8d1ebe37373b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:37.007249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a8bd1-37b6-454f-84b1-98cdbac8c6ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.008845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a8bd1-37b6-454f-84b1-98cdbac8c6ec admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.010539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 113/222] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:37.011123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a8bd1-37b6-454f-84b1-98cdbac8c6ec admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:37.013748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e9659bcf-cc0d-4d55-946c-8d1ebe37373b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:37.016018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 110/223] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:37.016018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9659bcf-cc0d-4d55-946c-8d1ebe37373b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:37.021076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a8bd1-37b6-454f-84b1-98cdbac8c6ec admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.025400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf57c2c-f634-4690-ae69-d1fab1e6b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.025754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9659bcf-cc0d-4d55-946c-8d1ebe37373b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.026232 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf57c2c-f634-4690-ae69-d1fab1e6b6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.026507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf57c2c-f634-4690-ae69-d1fab1e6b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.026775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf57c2c-f634-4690-ae69-d1fab1e6b6c1 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.027939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf57c2c-f634-4690-ae69-d1fab1e6b6c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.030042 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf57c2c-f634-4690-ae69-d1fab1e6b6c1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.030250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f123ee-7ea1-4a7f-a29b-076d221dbf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.030856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f123ee-7ea1-4a7f-a29b-076d221dbf1f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.031138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f123ee-7ea1-4a7f-a29b-076d221dbf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.031409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f123ee-7ea1-4a7f-a29b-076d221dbf1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.031679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 114/224] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:37 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:37.036248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf57c2c-f634-4690-ae69-d1fab1e6b6c1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:37.039391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f123ee-7ea1-4a7f-a29b-076d221dbf1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.041048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf57c2c-f634-4690-ae69-d1fab1e6b6c1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.041148 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f123ee-7ea1-4a7f-a29b-076d221dbf1f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.045365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47233c-2a70-4e53-a63d-68519d611681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.045975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47233c-2a70-4e53-a63d-68519d611681 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.046251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47233c-2a70-4e53-a63d-68519d611681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.046517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47233c-2a70-4e53-a63d-68519d611681 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.047203 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47233c-2a70-4e53-a63d-68519d611681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.049019 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47233c-2a70-4e53-a63d-68519d611681 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.049976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 111/225] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:37.050739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f123ee-7ea1-4a7f-a29b-076d221dbf1f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:37.059360 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f123ee-7ea1-4a7f-a29b-076d221dbf1f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.063783 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf09fa4-2233-4c7e-aa2c-f528d7f9a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.064399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf09fa4-2233-4c7e-aa2c-f528d7f9a494 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.064672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf09fa4-2233-4c7e-aa2c-f528d7f9a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.064957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf09fa4-2233-4c7e-aa2c-f528d7f9a494 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.065713 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf09fa4-2233-4c7e-aa2c-f528d7f9a494 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:37.066010 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf09fa4-2233-4c7e-aa2c-f528d7f9a494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.067534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf09fa4-2233-4c7e-aa2c-f528d7f9a494 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.069462 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 115/226] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:12:37 2022] POST /identity/v3/users => generated 297 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:37.070034 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47233c-2a70-4e53-a63d-68519d611681 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:37.076000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 112/227] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:37.076849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf09fa4-2233-4c7e-aa2c-f528d7f9a494 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:37.090669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47233c-2a70-4e53-a63d-68519d611681 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.091102 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf09fa4-2233-4c7e-aa2c-f528d7f9a494 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.095496 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2bc34-1467-4579-9a26-af8aa89d7499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.095863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03ab61-eed1-4799-b9a6-5892b2bdb3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.096432 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2bc34-1467-4579-9a26-af8aa89d7499 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.096707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2bc34-1467-4579-9a26-af8aa89d7499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.096797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03ab61-eed1-4799-b9a6-5892b2bdb3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.096981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2bc34-1467-4579-9a26-af8aa89d7499 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.097082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03ab61-eed1-4799-b9a6-5892b2bdb3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.097335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03ab61-eed1-4799-b9a6-5892b2bdb3aa admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/users/8bc3c2709c8449d2a20aad604f58978b/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.098602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2bc34-1467-4579-9a26-af8aa89d7499 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.099765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03ab61-eed1-4799-b9a6-5892b2bdb3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f075290bd58d4cc388aa95e6b59b2fab, user_id=8bc3c2709c8449d2a20aad604f58978b, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.100671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2bc34-1467-4579-9a26-af8aa89d7499 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.102763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03ab61-eed1-4799-b9a6-5892b2bdb3aa admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.102868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 113/228] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:37 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:37.103379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2bc34-1467-4579-9a26-af8aa89d7499 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:37.113033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2bc34-1467-4579-9a26-af8aa89d7499 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.129351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 116/229] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:12:37 2022] PUT /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/users/8bc3c2709c8449d2a20aad604f58978b/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:37.131653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03ab61-eed1-4799-b9a6-5892b2bdb3aa admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:37.184189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2a35f-563f-4f40-86ac-92fd18db7292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.185685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2a35f-563f-4f40-86ac-92fd18db7292 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.186712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2a35f-563f-4f40-86ac-92fd18db7292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.187269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2a35f-563f-4f40-86ac-92fd18db7292 admin admin] PATH_INFO: `/v3/users/8bc3c2709c8449d2a20aad604f58978b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.189857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2a35f-563f-4f40-86ac-92fd18db7292 admin admin] RBAC: Authorizing `identity:get_user(user_id=8bc3c2709c8449d2a20aad604f58978b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.193119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2a35f-563f-4f40-86ac-92fd18db7292 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.201133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 114/230] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:37 2022] GET /identity/v3/users/8bc3c2709c8449d2a20aad604f58978b => generated 283 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:37.202208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2a35f-563f-4f40-86ac-92fd18db7292 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:37.214325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2a35f-563f-4f40-86ac-92fd18db7292 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.219541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cfef7-229e-4518-bce1-6112f3e02a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.220393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cfef7-229e-4518-bce1-6112f3e02a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.222609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cfef7-229e-4518-bce1-6112f3e02a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.222609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cfef7-229e-4518-bce1-6112f3e02a60 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.225813 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cfef7-229e-4518-bce1-6112f3e02a60 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.227541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cfef7-229e-4518-bce1-6112f3e02a60 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.233276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 115/231] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:37 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:37.235816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03ab61-eed1-4799-b9a6-5892b2bdb3aa admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.240282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cfef7-229e-4518-bce1-6112f3e02a60 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:37.243321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede1b21-6988-4362-8764-c13b474ea697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.244344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1b21-6988-4362-8764-c13b474ea697 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.244865 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1b21-6988-4362-8764-c13b474ea697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.245370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede1b21-6988-4362-8764-c13b474ea697 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.246522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede1b21-6988-4362-8764-c13b474ea697 admin admin] RBAC: Adding query filter params (role.id=726ccf812eba475187c3df7288e1d46b, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab, user.id=517f9a7425d8416b9c51a31152c4e940) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:37.247250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede1b21-6988-4362-8764-c13b474ea697 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.249501 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede1b21-6988-4362-8764-c13b474ea697 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.251168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cfef7-229e-4518-bce1-6112f3e02a60 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:37.256409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 117/232] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:37 2022] GET /identity/v3/role_assignments?user.id=517f9a7425d8416b9c51a31152c4e940&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=726ccf812eba475187c3df7288e1d46b => generated 259 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:37.257192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802fb70-8dcf-4943-b5ac-61368578659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:37.258121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fb70-8dcf-4943-b5ac-61368578659a admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:37.258392 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fb70-8dcf-4943-b5ac-61368578659a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:37.258666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802fb70-8dcf-4943-b5ac-61368578659a admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/users/8bc3c2709c8449d2a20aad604f58978b/roles/7cc6510c2843471b8db1852425803574` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:37.261062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802fb70-8dcf-4943-b5ac-61368578659a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f075290bd58d4cc388aa95e6b59b2fab, user_id=8bc3c2709c8449d2a20aad604f58978b, role_id=7cc6510c2843471b8db1852425803574)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:37.264011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802fb70-8dcf-4943-b5ac-61368578659a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:37.280790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 116/233] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:12:37 2022] PUT /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/users/8bc3c2709c8449d2a20aad604f58978b/roles/7cc6510c2843471b8db1852425803574 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:12:39.875636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0edca-9d86-4294-a85b-808554eb256e None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:39.876184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0edca-9d86-4294-a85b-808554eb256e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:39.876184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0edca-9d86-4294-a85b-808554eb256e None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:39.880049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 118/234] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:39.884531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a61aa-556a-44a7-9c96-8a393f7113f7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:39.885028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a61aa-556a-44a7-9c96-8a393f7113f7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:39.885128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a61aa-556a-44a7-9c96-8a393f7113f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:39.907672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-309a61aa-556a-44a7-9c96-8a393f7113f7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:39.908866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-309a61aa-556a-44a7-9c96-8a393f7113f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:39.973152 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d7305-5979-4d2c-8f53-40e773700fea None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:39.973842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d7305-5979-4d2c-8f53-40e773700fea None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:39.974105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d7305-5979-4d2c-8f53-40e773700fea None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:39.975709 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 117/235] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:39.976074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 119/236] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:12:39.991613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fd2fe-7aa8-472d-97f5-f826f35337e1 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:39.991769 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289974-5a74-478e-b7c3-53231d08df7b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:39.991973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fd2fe-7aa8-472d-97f5-f826f35337e1 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:39.992086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289974-5a74-478e-b7c3-53231d08df7b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:39.992157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fd2fe-7aa8-472d-97f5-f826f35337e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:39.992221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289974-5a74-478e-b7c3-53231d08df7b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:39.993970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 118/237] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:39.999448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3841b6-a015-4479-9020-f20350befae8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:39.999735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3841b6-a015-4479-9020-f20350befae8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.000011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3841b6-a015-4479-9020-f20350befae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.019522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-c76fd2fe-7aa8-472d-97f5-f826f35337e1 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:40.019895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-da3841b6-a015-4479-9020-f20350befae8 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:40.020718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c76fd2fe-7aa8-472d-97f5-f826f35337e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:40.021076 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-da3841b6-a015-4479-9020-f20350befae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:40.028526 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 120/238] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 28 01:12:40.029108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fd2fe-7aa8-472d-97f5-f826f35337e1 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.034060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 119/239] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:40.048181 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fd2fe-7aa8-472d-97f5-f826f35337e1 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.054506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3841b6-a015-4479-9020-f20350befae8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.058337 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d3ef3-b926-42ef-80ba-2cd3f4c3c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.059150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d3ef3-b926-42ef-80ba-2cd3f4c3c6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.059469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d3ef3-b926-42ef-80ba-2cd3f4c3c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.059738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d3ef3-b926-42ef-80ba-2cd3f4c3c6f3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.065697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3841b6-a015-4479-9020-f20350befae8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.070615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d3ef3-b926-42ef-80ba-2cd3f4c3c6f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:40.071015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504cb5c-73ec-4957-a4a3-62e213e42cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.071814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504cb5c-73ec-4957-a4a3-62e213e42cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.072098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504cb5c-73ec-4957-a4a3-62e213e42cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.072377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504cb5c-73ec-4957-a4a3-62e213e42cbe admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.077537 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-b29d3ef3-b926-42ef-80ba-2cd3f4c3c6f3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:40.078963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 121/240] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:40.079982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc6750-1eba-44e9-ad09-a331b1ef435f None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.080261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc6750-1eba-44e9-ad09-a331b1ef435f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.080531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc6750-1eba-44e9-ad09-a331b1ef435f None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.082483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 122/241] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:40.083179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc6750-1eba-44e9-ad09-a331b1ef435f None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.083733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504cb5c-73ec-4957-a4a3-62e213e42cbe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:40.091816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9504cb5c-73ec-4957-a4a3-62e213e42cbe admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 28 01:12:40.093143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 120/242] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:12:40.094237 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d6a2f-a022-4eff-8f0b-29b68eff5b6e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.094521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d6a2f-a022-4eff-8f0b-29b68eff5b6e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.097527 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d6a2f-a022-4eff-8f0b-29b68eff5b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.097953 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc6750-1eba-44e9-ad09-a331b1ef435f None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.102687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a166ce-d9df-4cc5-827f-82ec153daa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.103470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a166ce-d9df-4cc5-827f-82ec153daa20 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.103742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a166ce-d9df-4cc5-827f-82ec153daa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.104018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a166ce-d9df-4cc5-827f-82ec153daa20 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.115017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a166ce-d9df-4cc5-827f-82ec153daa20 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:40.115837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7a6d6a2f-a022-4eff-8f0b-29b68eff5b6e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:40.117005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7a6d6a2f-a022-4eff-8f0b-29b68eff5b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:40.122194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-76a166ce-d9df-4cc5-827f-82ec153daa20 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:40.123572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 123/243] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:40.124173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a166ce-d9df-4cc5-827f-82ec153daa20 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.128905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 121/244] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:40.129968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d6a2f-a022-4eff-8f0b-29b68eff5b6e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.134317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a166ce-d9df-4cc5-827f-82ec153daa20 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.139104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05751edb-873a-419a-b4e1-23c7971a6070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.139966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05751edb-873a-419a-b4e1-23c7971a6070 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.140457 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05751edb-873a-419a-b4e1-23c7971a6070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.140916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05751edb-873a-419a-b4e1-23c7971a6070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.141283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d6a2f-a022-4eff-8f0b-29b68eff5b6e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.142125 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05751edb-873a-419a-b4e1-23c7971a6070 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:40.142616 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05751edb-873a-419a-b4e1-23c7971a6070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.144424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05751edb-873a-419a-b4e1-23c7971a6070 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.145643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eac2ef-9103-4d3b-bf83-333f761e95d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.146473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac2ef-9103-4d3b-bf83-333f761e95d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.146761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac2ef-9103-4d3b-bf83-333f761e95d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.147039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac2ef-9103-4d3b-bf83-333f761e95d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.148159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eac2ef-9103-4d3b-bf83-333f761e95d3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:40.148471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eac2ef-9103-4d3b-bf83-333f761e95d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.150103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eac2ef-9103-4d3b-bf83-333f761e95d3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.154771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 124/245] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.155792 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05751edb-873a-419a-b4e1-23c7971a6070 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.159615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 122/246] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.160492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eac2ef-9103-4d3b-bf83-333f761e95d3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.166080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05751edb-873a-419a-b4e1-23c7971a6070 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.170055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eac2ef-9103-4d3b-bf83-333f761e95d3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.170707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080ac3b-e54e-402f-b52a-9fb09e8f01b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.171372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080ac3b-e54e-402f-b52a-9fb09e8f01b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.171653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080ac3b-e54e-402f-b52a-9fb09e8f01b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.171924 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080ac3b-e54e-402f-b52a-9fb09e8f01b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.172691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080ac3b-e54e-402f-b52a-9fb09e8f01b8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:40.172997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080ac3b-e54e-402f-b52a-9fb09e8f01b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.174259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d4d28-fe11-4093-8356-9b7351111e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.174618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080ac3b-e54e-402f-b52a-9fb09e8f01b8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.175029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d4d28-fe11-4093-8356-9b7351111e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.175308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d4d28-fe11-4093-8356-9b7351111e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.175581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d4d28-fe11-4093-8356-9b7351111e5f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.176739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d4d28-fe11-4093-8356-9b7351111e5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.178422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d4d28-fe11-4093-8356-9b7351111e5f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.179981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 123/247] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.180713 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d4d28-fe11-4093-8356-9b7351111e5f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.188154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 125/248] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.188154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2e30-fac1-4a2a-922c-2139bd039b54 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.188154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2e30-fac1-4a2a-922c-2139bd039b54 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.188154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2e30-fac1-4a2a-922c-2139bd039b54 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.188154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 126/249] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:40.188154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2e30-fac1-4a2a-922c-2139bd039b54 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.191283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d4d28-fe11-4093-8356-9b7351111e5f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.195736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c1e51-f5e7-4e3e-a8af-4fc77adc0115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.196577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1e51-f5e7-4e3e-a8af-4fc77adc0115 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.196859 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1e51-f5e7-4e3e-a8af-4fc77adc0115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.197129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1e51-f5e7-4e3e-a8af-4fc77adc0115 admin admin] PATH_INFO: `/v3/users/8bc3c2709c8449d2a20aad604f58978b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.198366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c1e51-f5e7-4e3e-a8af-4fc77adc0115 admin admin] RBAC: Authorizing `identity:get_user(user_id=8bc3c2709c8449d2a20aad604f58978b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.199085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2e30-fac1-4a2a-922c-2139bd039b54 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.200494 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c1e51-f5e7-4e3e-a8af-4fc77adc0115 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.202116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 124/250] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/users/8bc3c2709c8449d2a20aad604f58978b => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.202839 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c1e51-f5e7-4e3e-a8af-4fc77adc0115 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.207557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce844d0c-19fe-4fce-8e59-af2c633abe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.208381 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce844d0c-19fe-4fce-8e59-af2c633abe58 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.208651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce844d0c-19fe-4fce-8e59-af2c633abe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.208912 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce844d0c-19fe-4fce-8e59-af2c633abe58 admin admin] PATH_INFO: `/v3/users/c76e36757610429dbe281b1e9405e006` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.211804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c1e51-f5e7-4e3e-a8af-4fc77adc0115 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.216052 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf640e-aef0-479d-9fbe-b8dab090ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.216659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf640e-aef0-479d-9fbe-b8dab090ee32 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.216939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf640e-aef0-479d-9fbe-b8dab090ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.217212 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf640e-aef0-479d-9fbe-b8dab090ee32 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.217936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf640e-aef0-479d-9fbe-b8dab090ee32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.219765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf640e-aef0-479d-9fbe-b8dab090ee32 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.222106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce844d0c-19fe-4fce-8e59-af2c633abe58 admin admin] RBAC: Authorizing `identity:get_user(user_id=c76e36757610429dbe281b1e9405e006)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.224611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce844d0c-19fe-4fce-8e59-af2c633abe58 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.226283 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 127/251] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/users/c76e36757610429dbe281b1e9405e006 => generated 297 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.227021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce844d0c-19fe-4fce-8e59-af2c633abe58 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.236981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce844d0c-19fe-4fce-8e59-af2c633abe58 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.249258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 125/252] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:12:40 2022] POST /identity/v3/users => generated 293 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:40.249526 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171520a-b799-4ad0-9d88-2f8922b4c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.249623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1bfbb-4cdf-4047-b12f-3b7b3c5905a6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.249623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1bfbb-4cdf-4047-b12f-3b7b3c5905a6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.249742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171520a-b799-4ad0-9d88-2f8922b4c956 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.249804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1bfbb-4cdf-4047-b12f-3b7b3c5905a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.249880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171520a-b799-4ad0-9d88-2f8922b4c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.249880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171520a-b799-4ad0-9d88-2f8922b4c956 admin admin] PATH_INFO: `/v3/users/8bc3c2709c8449d2a20aad604f58978b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.249880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171520a-b799-4ad0-9d88-2f8922b4c956 admin admin] RBAC: Authorizing `identity:get_user(user_id=8bc3c2709c8449d2a20aad604f58978b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.249880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171520a-b799-4ad0-9d88-2f8922b4c956 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.249880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 128/253] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/users/8bc3c2709c8449d2a20aad604f58978b => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.249880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171520a-b799-4ad0-9d88-2f8922b4c956 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.260274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171520a-b799-4ad0-9d88-2f8922b4c956 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.264843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e2503-ef3c-4d84-9f04-9857a2046ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.265544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e2503-ef3c-4d84-9f04-9857a2046ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.265829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e2503-ef3c-4d84-9f04-9857a2046ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.266099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e2503-ef3c-4d84-9f04-9857a2046ab6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.270243 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e9a1bfbb-4cdf-4047-b12f-3b7b3c5905a6 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:40.271481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e9a1bfbb-4cdf-4047-b12f-3b7b3c5905a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:40.275293 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e2503-ef3c-4d84-9f04-9857a2046ab6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.277126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e2503-ef3c-4d84-9f04-9857a2046ab6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.280335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 126/254] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:40.281023 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1bfbb-4cdf-4047-b12f-3b7b3c5905a6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.289359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 129/255] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:40.289359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e2503-ef3c-4d84-9f04-9857a2046ab6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.297643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1bfbb-4cdf-4047-b12f-3b7b3c5905a6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.303645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e2503-ef3c-4d84-9f04-9857a2046ab6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.311344 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d3e1-b5e5-4a6c-ba16-da286138a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.312017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d3e1-b5e5-4a6c-ba16-da286138a273 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.312296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d3e1-b5e5-4a6c-ba16-da286138a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.312627 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d3e1-b5e5-4a6c-ba16-da286138a273 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.312985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f2b30-be5b-476d-b54d-45d96db158d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.313782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f2b30-be5b-476d-b54d-45d96db158d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.314123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f2b30-be5b-476d-b54d-45d96db158d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.314459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f2b30-be5b-476d-b54d-45d96db158d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.321461 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577d3e1-b5e5-4a6c-ba16-da286138a273 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.323022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f2b30-be5b-476d-b54d-45d96db158d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.323337 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577d3e1-b5e5-4a6c-ba16-da286138a273 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.324773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f2b30-be5b-476d-b54d-45d96db158d8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.333600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 127/256] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:40.334477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 130/257] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:40.335240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f2b30-be5b-476d-b54d-45d96db158d8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.335564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d3e1-b5e5-4a6c-ba16-da286138a273 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.345383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f2b30-be5b-476d-b54d-45d96db158d8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.345670 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d3e1-b5e5-4a6c-ba16-da286138a273 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.350386 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee846b-af18-4e26-a9ce-f8ca421faa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.350555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728b32c-9550-4eb2-879f-b44854d9a447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.351253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee846b-af18-4e26-a9ce-f8ca421faa79 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.351362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728b32c-9550-4eb2-879f-b44854d9a447 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.351537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee846b-af18-4e26-a9ce-f8ca421faa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.351626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728b32c-9550-4eb2-879f-b44854d9a447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.351797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee846b-af18-4e26-a9ce-f8ca421faa79 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.351888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728b32c-9550-4eb2-879f-b44854d9a447 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.353007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee846b-af18-4e26-a9ce-f8ca421faa79 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.355096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee846b-af18-4e26-a9ce-f8ca421faa79 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.356915 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 128/258] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.357733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee846b-af18-4e26-a9ce-f8ca421faa79 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.363232 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728b32c-9550-4eb2-879f-b44854d9a447 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:40.367380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee846b-af18-4e26-a9ce-f8ca421faa79 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.370793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-b728b32c-9550-4eb2-879f-b44854d9a447 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:40.371789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efd539-de54-403b-bfc2-283058a0cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.372392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 131/259] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:40.372688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd539-de54-403b-bfc2-283058a0cab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.372964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd539-de54-403b-bfc2-283058a0cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.373259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efd539-de54-403b-bfc2-283058a0cab6 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.377736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efd539-de54-403b-bfc2-283058a0cab6 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.378101 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728b32c-9550-4eb2-879f-b44854d9a447 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.379799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efd539-de54-403b-bfc2-283058a0cab6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.381718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 129/260] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.382326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efd539-de54-403b-bfc2-283058a0cab6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.393471 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728b32c-9550-4eb2-879f-b44854d9a447 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.393648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efd539-de54-403b-bfc2-283058a0cab6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.396290 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcb970-2f3e-4fbe-8fea-658aa4fd3631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.397040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb2b8-aaad-4ed0-8d1a-97e17b730333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.397151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcb970-2f3e-4fbe-8fea-658aa4fd3631 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.397474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcb970-2f3e-4fbe-8fea-658aa4fd3631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.397957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcb970-2f3e-4fbe-8fea-658aa4fd3631 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.399198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcb970-2f3e-4fbe-8fea-658aa4fd3631 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.399763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb2b8-aaad-4ed0-8d1a-97e17b730333 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.400020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb2b8-aaad-4ed0-8d1a-97e17b730333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.400286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb2b8-aaad-4ed0-8d1a-97e17b730333 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.401131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb2b8-aaad-4ed0-8d1a-97e17b730333 admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab, user.id=8bc3c2709c8449d2a20aad604f58978b) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:40.401313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcb970-2f3e-4fbe-8fea-658aa4fd3631 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.401471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb2b8-aaad-4ed0-8d1a-97e17b730333 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.403261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 132/261] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.403452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb2b8-aaad-4ed0-8d1a-97e17b730333 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.403950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcb970-2f3e-4fbe-8fea-658aa4fd3631 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.413393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 130/262] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/role_assignments?user.id=8bc3c2709c8449d2a20aad604f58978b&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.413393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb2b8-aaad-4ed0-8d1a-97e17b730333 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.415676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcb970-2f3e-4fbe-8fea-658aa4fd3631 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.422689 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b5f7d-f6e5-4c3e-ba76-51fe3dba7bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.423380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5f7d-f6e5-4c3e-ba76-51fe3dba7bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.423658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5f7d-f6e5-4c3e-ba76-51fe3dba7bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.423932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b5f7d-f6e5-4c3e-ba76-51fe3dba7bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.424787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b5f7d-f6e5-4c3e-ba76-51fe3dba7bcf admin admin] RBAC: Adding query filter params (name=member) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:40.425003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb2b8-aaad-4ed0-8d1a-97e17b730333 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.425122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b5f7d-f6e5-4c3e-ba76-51fe3dba7bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.426913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b5f7d-f6e5-4c3e-ba76-51fe3dba7bcf admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.430285 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7356a08-26d3-4561-85a1-d31274795ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.431177 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7356a08-26d3-4561-85a1-d31274795ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.431611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7356a08-26d3-4561-85a1-d31274795ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.432015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7356a08-26d3-4561-85a1-d31274795ec3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.433015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7356a08-26d3-4561-85a1-d31274795ec3 admin admin] RBAC: Adding query filter params (role.id=c8891868ea2c4086af4903f6050eecc4, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab, user.id=c76e36757610429dbe281b1e9405e006) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:40.433497 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7356a08-26d3-4561-85a1-d31274795ec3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.435603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7356a08-26d3-4561-85a1-d31274795ec3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.438484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 133/263] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.440167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b5f7d-f6e5-4c3e-ba76-51fe3dba7bcf admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.442161 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 131/264] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/role_assignments?user.id=c76e36757610429dbe281b1e9405e006&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=c8891868ea2c4086af4903f6050eecc4 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.444700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7356a08-26d3-4561-85a1-d31274795ec3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.460029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7356a08-26d3-4561-85a1-d31274795ec3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.460747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b5f7d-f6e5-4c3e-ba76-51fe3dba7bcf admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.465099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8b974-eb4b-4f87-b4f2-70c0759aac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.466353 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7434063-f674-4ab5-8aea-00308b5b1fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.466554 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b974-eb4b-4f87-b4f2-70c0759aac8b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.468091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b974-eb4b-4f87-b4f2-70c0759aac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.468091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b974-eb4b-4f87-b4f2-70c0759aac8b admin admin] PATH_INFO: `/v3/users/517f9a7425d8416b9c51a31152c4e940` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.468846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8b974-eb4b-4f87-b4f2-70c0759aac8b admin admin] RBAC: Authorizing `identity:get_user(user_id=517f9a7425d8416b9c51a31152c4e940)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.469426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7434063-f674-4ab5-8aea-00308b5b1fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.469847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7434063-f674-4ab5-8aea-00308b5b1fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.470261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7434063-f674-4ab5-8aea-00308b5b1fa1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.471376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7434063-f674-4ab5-8aea-00308b5b1fa1 admin admin] RBAC: Adding query filter params (role.id=7cc6510c2843471b8db1852425803574, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab, user.id=8bc3c2709c8449d2a20aad604f58978b) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:40.471605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8b974-eb4b-4f87-b4f2-70c0759aac8b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.471994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7434063-f674-4ab5-8aea-00308b5b1fa1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.474366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 132/265] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/users/517f9a7425d8416b9c51a31152c4e940 => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.474834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7434063-f674-4ab5-8aea-00308b5b1fa1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.481972 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8b974-eb4b-4f87-b4f2-70c0759aac8b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.487263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 134/266] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/role_assignments?user.id=8bc3c2709c8449d2a20aad604f58978b&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=7cc6510c2843471b8db1852425803574 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.494426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8b974-eb4b-4f87-b4f2-70c0759aac8b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.503486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe1c62-b8ec-4fa9-98e4-66659e0347ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.504821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1c62-b8ec-4fa9-98e4-66659e0347ee admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.505657 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1c62-b8ec-4fa9-98e4-66659e0347ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.506152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1c62-b8ec-4fa9-98e4-66659e0347ee admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.510974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe1c62-b8ec-4fa9-98e4-66659e0347ee admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.513797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe1c62-b8ec-4fa9-98e4-66659e0347ee admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.516542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 133/267] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:40 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:40.524042 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7434063-f674-4ab5-8aea-00308b5b1fa1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:40.534999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7434063-f674-4ab5-8aea-00308b5b1fa1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:40.540913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074bc0d-a869-44ec-a2a5-ca8b782b196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:40.541891 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074bc0d-a869-44ec-a2a5-ca8b782b196a admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:40.542170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074bc0d-a869-44ec-a2a5-ca8b782b196a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:40.542443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074bc0d-a869-44ec-a2a5-ca8b782b196a admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/users/517f9a7425d8416b9c51a31152c4e940/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:40.544710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074bc0d-a869-44ec-a2a5-ca8b782b196a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f075290bd58d4cc388aa95e6b59b2fab, user_id=517f9a7425d8416b9c51a31152c4e940, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:40.547494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074bc0d-a869-44ec-a2a5-ca8b782b196a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:40.565943 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 135/268] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:12:40 2022] PUT /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/users/517f9a7425d8416b9c51a31152c4e940/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:42.701408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd38333-11cd-48b0-bf34-a38a6c693565 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.701933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd38333-11cd-48b0-bf34-a38a6c693565 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.701933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd38333-11cd-48b0-bf34-a38a6c693565 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.703882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 134/269] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:42.709637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1997-0712-426c-b58f-f9c4f7fd1500 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.710505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1997-0712-426c-b58f-f9c4f7fd1500 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.711025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f1997-0712-426c-b58f-f9c4f7fd1500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.729586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b93f1997-0712-426c-b58f-f9c4f7fd1500 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:42.731109 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b93f1997-0712-426c-b58f-f9c4f7fd1500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:42.787556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 136/270] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:42.810817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd38333-11cd-48b0-bf34-a38a6c693565 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:42.825141 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd38333-11cd-48b0-bf34-a38a6c693565 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:42.829903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91c2f0-79e5-44f7-a2df-422b3e4717d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:42.830932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91c2f0-79e5-44f7-a2df-422b3e4717d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.831424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91c2f0-79e5-44f7-a2df-422b3e4717d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.831919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91c2f0-79e5-44f7-a2df-422b3e4717d8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.842906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91c2f0-79e5-44f7-a2df-422b3e4717d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:42.845150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bf2a6-722d-4fcc-824f-f5a6d088c42b None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.845471 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bf2a6-722d-4fcc-824f-f5a6d088c42b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.845744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bf2a6-722d-4fcc-824f-f5a6d088c42b None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.847662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 137/271] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:42.850607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c54f-4a8f-4cb7-8a7c-4142b1ffe6f2 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.850890 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c54f-4a8f-4cb7-8a7c-4142b1ffe6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.851162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c54f-4a8f-4cb7-8a7c-4142b1ffe6f2 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.853084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 138/272] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:12:42.854901 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ec91c2f0-79e5-44f7-a2df-422b3e4717d8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 28 01:12:42.855159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d9d4-c996-4b67-ad42-1c6d43ad03db None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.855440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d9d4-c996-4b67-ad42-1c6d43ad03db None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.855711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67d9d4-c996-4b67-ad42-1c6d43ad03db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.856467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 135/273] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:42.859356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ec577-b71c-46dd-8d74-55472ca24fa7 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.859647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ec577-b71c-46dd-8d74-55472ca24fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.859922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ec577-b71c-46dd-8d74-55472ca24fa7 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.861866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 136/274] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:12:42.862898 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49982be-70b9-46fd-a611-7d04ceca851d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.863179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49982be-70b9-46fd-a611-7d04ceca851d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.863448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49982be-70b9-46fd-a611-7d04ceca851d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.876195 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-bc67d9d4-c996-4b67-ad42-1c6d43ad03db None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:42.877446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-bc67d9d4-c996-4b67-ad42-1c6d43ad03db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:42.882356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b49982be-70b9-46fd-a611-7d04ceca851d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:42.883445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b49982be-70b9-46fd-a611-7d04ceca851d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:42.884940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 139/275] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:42.885742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67d9d4-c996-4b67-ad42-1c6d43ad03db None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:42.892033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 137/276] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:42.897308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f0827-c47b-442f-b0bf-070df78cbecb None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.897308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f0827-c47b-442f-b0bf-070df78cbecb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.897308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f0827-c47b-442f-b0bf-070df78cbecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.897594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67d9d4-c996-4b67-ad42-1c6d43ad03db None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:42.901497 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a62c-580f-4578-98fa-7ab5b9459abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:42.902211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a62c-580f-4578-98fa-7ab5b9459abf admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.902560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a62c-580f-4578-98fa-7ab5b9459abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.902909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a62c-580f-4578-98fa-7ab5b9459abf admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.903776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a62c-580f-4578-98fa-7ab5b9459abf admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:42.904148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a62c-580f-4578-98fa-7ab5b9459abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:42.905883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a62c-580f-4578-98fa-7ab5b9459abf admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:42.914684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b45f0827-c47b-442f-b0bf-070df78cbecb None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:42.914877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 140/277] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:42.916338 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b45f0827-c47b-442f-b0bf-070df78cbecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:42.916868 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a62c-580f-4578-98fa-7ab5b9459abf admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:42.924162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 138/278] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:42.924991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f0827-c47b-442f-b0bf-070df78cbecb None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:42.926569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a62c-580f-4578-98fa-7ab5b9459abf admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:42.930814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abefa0-c277-4a77-b4ea-0e63200dd68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:42.931588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abefa0-c277-4a77-b4ea-0e63200dd68c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.931871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abefa0-c277-4a77-b4ea-0e63200dd68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.932145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abefa0-c277-4a77-b4ea-0e63200dd68c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.933340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abefa0-c277-4a77-b4ea-0e63200dd68c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:42.934019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f0827-c47b-442f-b0bf-070df78cbecb None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:42.935122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abefa0-c277-4a77-b4ea-0e63200dd68c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:42.936812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 141/279] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:42.937442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abefa0-c277-4a77-b4ea-0e63200dd68c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:42.938630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeddd5-59da-4d26-80bb-2dbfa7fcaf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:42.939391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeddd5-59da-4d26-80bb-2dbfa7fcaf7a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.939666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeddd5-59da-4d26-80bb-2dbfa7fcaf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.939935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aeddd5-59da-4d26-80bb-2dbfa7fcaf7a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.946525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abefa0-c277-4a77-b4ea-0e63200dd68c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:42.950924 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f23fe3-9cb3-478c-a674-184db12e4560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:42.951662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aeddd5-59da-4d26-80bb-2dbfa7fcaf7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:42.951763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23fe3-9cb3-478c-a674-184db12e4560 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.951946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23fe3-9cb3-478c-a674-184db12e4560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.952221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f23fe3-9cb3-478c-a674-184db12e4560 admin admin] PATH_INFO: `/v3/users/c76e36757610429dbe281b1e9405e006` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.953447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f23fe3-9cb3-478c-a674-184db12e4560 admin admin] RBAC: Authorizing `identity:get_user(user_id=c76e36757610429dbe281b1e9405e006)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:42.955533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f23fe3-9cb3-478c-a674-184db12e4560 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:42.957274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 142/280] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:42 2022] GET /identity/v3/users/c76e36757610429dbe281b1e9405e006 => generated 297 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:42.957857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f23fe3-9cb3-478c-a674-184db12e4560 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:42.958672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a0aeddd5-59da-4d26-80bb-2dbfa7fcaf7a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:42.961464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 139/281] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:42.961464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeddd5-59da-4d26-80bb-2dbfa7fcaf7a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:42.968905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f23fe3-9cb3-478c-a674-184db12e4560 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:42.970525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aeddd5-59da-4d26-80bb-2dbfa7fcaf7a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:42.973953 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4fc21-df41-460c-8f59-6212953a95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:42.974582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4fc21-df41-460c-8f59-6212953a95c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.974856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4fc21-df41-460c-8f59-6212953a95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.975121 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4fc21-df41-460c-8f59-6212953a95c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.975405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd3930-b8ac-410b-88f8-0354ceb79351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:42.975821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4fc21-df41-460c-8f59-6212953a95c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:42.976120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd3930-b8ac-410b-88f8-0354ceb79351 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:42.976396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd3930-b8ac-410b-88f8-0354ceb79351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:42.976662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd3930-b8ac-410b-88f8-0354ceb79351 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:42.977729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4fc21-df41-460c-8f59-6212953a95c8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:42.987348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd3930-b8ac-410b-88f8-0354ceb79351 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:42.994839 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-d9fd3930-b8ac-410b-88f8-0354ceb79351 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:42.995920 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 140/282] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:42.997526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd3930-b8ac-410b-88f8-0354ceb79351 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:42.997637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 143/283] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:12:42 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:42.998078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4fc21-df41-460c-8f59-6212953a95c8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:43.010507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd3930-b8ac-410b-88f8-0354ceb79351 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:43.015611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4fc21-df41-460c-8f59-6212953a95c8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:43.016056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc12c3-014a-4be3-80c1-4b10e987cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:43.016951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc12c3-014a-4be3-80c1-4b10e987cdba admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:43.017263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc12c3-014a-4be3-80c1-4b10e987cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:43.017517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc12c3-014a-4be3-80c1-4b10e987cdba admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:43.018864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc12c3-014a-4be3-80c1-4b10e987cdba admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:43.020323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcacfdc-59e0-4c6c-9f48-522a098a6498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:43.021007 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcacfdc-59e0-4c6c-9f48-522a098a6498 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:43.021116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc12c3-014a-4be3-80c1-4b10e987cdba admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:43.021306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcacfdc-59e0-4c6c-9f48-522a098a6498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:43.021584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcacfdc-59e0-4c6c-9f48-522a098a6498 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:43.022358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcacfdc-59e0-4c6c-9f48-522a098a6498 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:43.022663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcacfdc-59e0-4c6c-9f48-522a098a6498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:43.027852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 141/284] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:42 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:43.027852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc12c3-014a-4be3-80c1-4b10e987cdba admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:43.028167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcacfdc-59e0-4c6c-9f48-522a098a6498 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:43.036033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 144/285] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:43.036931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcacfdc-59e0-4c6c-9f48-522a098a6498 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:43.038768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc12c3-014a-4be3-80c1-4b10e987cdba admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:43.044761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d5f4-1acf-4d00-8557-a41e7599c701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:43.045488 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d5f4-1acf-4d00-8557-a41e7599c701 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:43.045768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d5f4-1acf-4d00-8557-a41e7599c701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:43.046042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d5f4-1acf-4d00-8557-a41e7599c701 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:43.046804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d5f4-1acf-4d00-8557-a41e7599c701 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:43.047108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d5f4-1acf-4d00-8557-a41e7599c701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:43.048720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d5f4-1acf-4d00-8557-a41e7599c701 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:43.055776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcacfdc-59e0-4c6c-9f48-522a098a6498 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:43.058988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 142/286] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:43.059926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d5f4-1acf-4d00-8557-a41e7599c701 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:43.061479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09acb7-b101-4ec8-85fa-8d0ba11fa94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:43.062548 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09acb7-b101-4ec8-85fa-8d0ba11fa94c admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:43.062967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09acb7-b101-4ec8-85fa-8d0ba11fa94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:43.063433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09acb7-b101-4ec8-85fa-8d0ba11fa94c admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/users/c76e36757610429dbe281b1e9405e006/roles/c8891868ea2c4086af4903f6050eecc4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:43.066521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09acb7-b101-4ec8-85fa-8d0ba11fa94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f075290bd58d4cc388aa95e6b59b2fab, user_id=c76e36757610429dbe281b1e9405e006, role_id=c8891868ea2c4086af4903f6050eecc4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:43.069823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09acb7-b101-4ec8-85fa-8d0ba11fa94c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:43.070258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d5f4-1acf-4d00-8557-a41e7599c701 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:43.075798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f0959-067b-4495-a458-def9ef61b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:43.076711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f0959-067b-4495-a458-def9ef61b3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:43.076993 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f0959-067b-4495-a458-def9ef61b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:43.077436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f0959-067b-4495-a458-def9ef61b3f4 admin admin] PATH_INFO: `/v3/users/517f9a7425d8416b9c51a31152c4e940` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:43.078823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f0959-067b-4495-a458-def9ef61b3f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=517f9a7425d8416b9c51a31152c4e940)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:43.081260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f0959-067b-4495-a458-def9ef61b3f4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:43.083017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 143/287] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:43 2022] GET /identity/v3/users/517f9a7425d8416b9c51a31152c4e940 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:43.083017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f0959-067b-4495-a458-def9ef61b3f4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:43.088328 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 145/288] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:12:43 2022] PUT /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/users/c76e36757610429dbe281b1e9405e006/roles/c8891868ea2c4086af4903f6050eecc4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:43.089218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09acb7-b101-4ec8-85fa-8d0ba11fa94c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:43.099552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f0959-067b-4495-a458-def9ef61b3f4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:43.161276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09acb7-b101-4ec8-85fa-8d0ba11fa94c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:43.168987 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156fa1-4518-4f60-ab99-5010d84fae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:43.170026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156fa1-4518-4f60-ab99-5010d84fae36 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:43.170311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156fa1-4518-4f60-ab99-5010d84fae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:43.170588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156fa1-4518-4f60-ab99-5010d84fae36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:43.182810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6156fa1-4518-4f60-ab99-5010d84fae36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:43.184749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6156fa1-4518-4f60-ab99-5010d84fae36 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:43.188931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089bb95-74b9-4326-a0bf-fd393708af27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:43.189930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089bb95-74b9-4326-a0bf-fd393708af27 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:43.190201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089bb95-74b9-4326-a0bf-fd393708af27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:43.190465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089bb95-74b9-4326-a0bf-fd393708af27 admin admin] PATH_INFO: `/v3/users/64047af9c6804e1d967b8f143c401c66` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:43.197759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 146/289] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:43.204149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156fa1-4518-4f60-ab99-5010d84fae36 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:43.213680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156fa1-4518-4f60-ab99-5010d84fae36 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:43.216679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089bb95-74b9-4326-a0bf-fd393708af27 admin admin] RBAC: Authorizing `identity:get_user(user_id=64047af9c6804e1d967b8f143c401c66)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:43.221561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089bb95-74b9-4326-a0bf-fd393708af27 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:43.221723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a219dc-12bf-4d8f-a8e5-6c9b15c8ae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:43.221723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a219dc-12bf-4d8f-a8e5-6c9b15c8ae0a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:43.221723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a219dc-12bf-4d8f-a8e5-6c9b15c8ae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:43.221723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a219dc-12bf-4d8f-a8e5-6c9b15c8ae0a admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:43.221997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 144/290] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:43 2022] GET /identity/v3/users/64047af9c6804e1d967b8f143c401c66 => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:43.223984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a219dc-12bf-4d8f-a8e5-6c9b15c8ae0a admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:43.226687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a219dc-12bf-4d8f-a8e5-6c9b15c8ae0a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:43.227428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089bb95-74b9-4326-a0bf-fd393708af27 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:43.228650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 147/291] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:43 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:43.234691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a219dc-12bf-4d8f-a8e5-6c9b15c8ae0a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:43.239739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089bb95-74b9-4326-a0bf-fd393708af27 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:43.246862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268b4d9-045f-4b1d-a56d-3c6ae56f7336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:43.247565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b4d9-045f-4b1d-a56d-3c6ae56f7336 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:43.247842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b4d9-045f-4b1d-a56d-3c6ae56f7336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:43.248113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268b4d9-045f-4b1d-a56d-3c6ae56f7336 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:43.248971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268b4d9-045f-4b1d-a56d-3c6ae56f7336 admin admin] RBAC: Adding query filter params (role.id=726ccf812eba475187c3df7288e1d46b, user.id=64047af9c6804e1d967b8f143c401c66, scope.system=all) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:43.249891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268b4d9-045f-4b1d-a56d-3c6ae56f7336 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:43.250419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a219dc-12bf-4d8f-a8e5-6c9b15c8ae0a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:43.251827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268b4d9-045f-4b1d-a56d-3c6ae56f7336 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:43.256058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750bbd-692c-4d8f-bcdd-35c0f5555730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:43.256973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750bbd-692c-4d8f-bcdd-35c0f5555730 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:43.257532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750bbd-692c-4d8f-bcdd-35c0f5555730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:43.257990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750bbd-692c-4d8f-bcdd-35c0f5555730 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:43.259013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a750bbd-692c-4d8f-bcdd-35c0f5555730 admin admin] RBAC: Adding query filter params (role.id=726ccf812eba475187c3df7288e1d46b, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab, user.id=517f9a7425d8416b9c51a31152c4e940) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:43.259514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a750bbd-692c-4d8f-bcdd-35c0f5555730 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:43.261570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a750bbd-692c-4d8f-bcdd-35c0f5555730 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:43.269284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 145/292] 10.222.0.16 () {56 vars in 1329 bytes} [Fri Jan 28 01:12:43 2022] GET /identity/v3/role_assignments?user.id=64047af9c6804e1d967b8f143c401c66&scope.system=all&role.id=726ccf812eba475187c3df7288e1d46b => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:43.275048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 148/293] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:43 2022] GET /identity/v3/role_assignments?user.id=517f9a7425d8416b9c51a31152c4e940&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=726ccf812eba475187c3df7288e1d46b => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:45.363065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf2b8c-fca0-4812-94c8-e9ccfa071654 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.363594 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf2b8c-fca0-4812-94c8-e9ccfa071654 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.363594 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf2b8c-fca0-4812-94c8-e9ccfa071654 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.365546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 146/294] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:45.371315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11902df2-320e-4d58-9935-56cdbd8d6f11 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.371790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11902df2-320e-4d58-9935-56cdbd8d6f11 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.371966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11902df2-320e-4d58-9935-56cdbd8d6f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.389942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-11902df2-320e-4d58-9935-56cdbd8d6f11 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:45.391117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-11902df2-320e-4d58-9935-56cdbd8d6f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:45.405588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 149/295] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:45.422570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf2b8c-fca0-4812-94c8-e9ccfa071654 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.434812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf2b8c-fca0-4812-94c8-e9ccfa071654 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.439055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba19ef-4bfa-4559-a381-d38c86058e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.439838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba19ef-4bfa-4559-a381-d38c86058e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.440113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba19ef-4bfa-4559-a381-d38c86058e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.440380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba19ef-4bfa-4559-a381-d38c86058e02 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.451634 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba19ef-4bfa-4559-a381-d38c86058e02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:45.458561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-84ba19ef-4bfa-4559-a381-d38c86058e02 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 28 01:12:45.464510 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 147/296] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:45.465961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11902df2-320e-4d58-9935-56cdbd8d6f11 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.475267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11902df2-320e-4d58-9935-56cdbd8d6f11 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.479667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc30a19-1fcc-4e31-a29f-97fe9870078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.481551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc30a19-1fcc-4e31-a29f-97fe9870078d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.481858 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537f9da-895c-445d-b707-ec1837d280a7 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.481980 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc30a19-1fcc-4e31-a29f-97fe9870078d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.482177 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537f9da-895c-445d-b707-ec1837d280a7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.482362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc30a19-1fcc-4e31-a29f-97fe9870078d admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.482533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537f9da-895c-445d-b707-ec1837d280a7 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.483179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc30a19-1fcc-4e31-a29f-97fe9870078d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:45.483487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc30a19-1fcc-4e31-a29f-97fe9870078d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.484186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 148/297] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:12:45.485093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc30a19-1fcc-4e31-a29f-97fe9870078d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.489396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd638-bd6f-42bb-8453-6aaf22c98cb7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.489675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd638-bd6f-42bb-8453-6aaf22c98cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.489943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756dd638-bd6f-42bb-8453-6aaf22c98cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.494202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 150/298] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:45.499807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc30a19-1fcc-4e31-a29f-97fe9870078d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.514273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-756dd638-bd6f-42bb-8453-6aaf22c98cb7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:45.514825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc30a19-1fcc-4e31-a29f-97fe9870078d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.515463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-756dd638-bd6f-42bb-8453-6aaf22c98cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:45.519683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7ac54-915a-4d1b-8033-fcf0cf84f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.520827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7ac54-915a-4d1b-8033-fcf0cf84f8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.521271 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7ac54-915a-4d1b-8033-fcf0cf84f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.521682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7ac54-915a-4d1b-8033-fcf0cf84f8e6 admin admin] PATH_INFO: `/v3/users/c76e36757610429dbe281b1e9405e006` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.523049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7ac54-915a-4d1b-8033-fcf0cf84f8e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=c76e36757610429dbe281b1e9405e006)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.523860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 149/299] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:45.527177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7ac54-915a-4d1b-8033-fcf0cf84f8e6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.527613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 151/300] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/users/c76e36757610429dbe281b1e9405e006 => generated 297 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:45.529046 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94696191-9bd5-40d6-a91b-b52f3ce532bd None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.529377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94696191-9bd5-40d6-a91b-b52f3ce532bd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.529654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94696191-9bd5-40d6-a91b-b52f3ce532bd None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.531380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 150/301] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:45.534538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7ac54-915a-4d1b-8033-fcf0cf84f8e6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.538479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9509814-ff07-41b2-81b8-7aa498ab4f47 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.538764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9509814-ff07-41b2-81b8-7aa498ab4f47 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.539041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9509814-ff07-41b2-81b8-7aa498ab4f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.549433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7ac54-915a-4d1b-8033-fcf0cf84f8e6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.553747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de376f-bec7-4c8b-b0de-88c2cdca1186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.554383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de376f-bec7-4c8b-b0de-88c2cdca1186 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.554669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de376f-bec7-4c8b-b0de-88c2cdca1186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.554941 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de376f-bec7-4c8b-b0de-88c2cdca1186 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.556973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f9509814-ff07-41b2-81b8-7aa498ab4f47 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:45.558253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f9509814-ff07-41b2-81b8-7aa498ab4f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:45.562933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de376f-bec7-4c8b-b0de-88c2cdca1186 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.564724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de376f-bec7-4c8b-b0de-88c2cdca1186 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.565697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 151/302] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:45.567053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4387-39eb-4d1d-9db6-a07061a95329 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.567333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4387-39eb-4d1d-9db6-a07061a95329 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.567604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf4387-39eb-4d1d-9db6-a07061a95329 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.569382 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 152/303] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:45.573266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4387-39eb-4d1d-9db6-a07061a95329 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.577382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 152/304] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:45.578661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bfc5c-3389-459a-a775-6d164ca6ac8d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.578947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bfc5c-3389-459a-a775-6d164ca6ac8d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.579217 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bfc5c-3389-459a-a775-6d164ca6ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.585178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf4387-39eb-4d1d-9db6-a07061a95329 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.589476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df7a5-5c1b-4228-8016-2f15c12246a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.590236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df7a5-5c1b-4228-8016-2f15c12246a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.590624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df7a5-5c1b-4228-8016-2f15c12246a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.590901 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3df7a5-5c1b-4228-8016-2f15c12246a7 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.596138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-f14bfc5c-3389-459a-a775-6d164ca6ac8d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:45.597324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f14bfc5c-3389-459a-a775-6d164ca6ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:45.601416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3df7a5-5c1b-4228-8016-2f15c12246a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:45.604849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 153/305] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:45.605614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bfc5c-3389-459a-a775-6d164ca6ac8d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.608719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ea3df7a5-5c1b-4228-8016-2f15c12246a7 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 28 01:12:45.614205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 153/306] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:45.615294 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df7a5-5c1b-4228-8016-2f15c12246a7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.618888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bfc5c-3389-459a-a775-6d164ca6ac8d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.623225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7466661-0bbd-4c36-8ada-5a1f60922e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.624078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7466661-0bbd-4c36-8ada-5a1f60922e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.624357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7466661-0bbd-4c36-8ada-5a1f60922e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.624631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7466661-0bbd-4c36-8ada-5a1f60922e1b admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.625866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7466661-0bbd-4c36-8ada-5a1f60922e1b admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.628033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7466661-0bbd-4c36-8ada-5a1f60922e1b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.629102 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3df7a5-5c1b-4228-8016-2f15c12246a7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.629797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 154/307] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:45.630544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7466661-0bbd-4c36-8ada-5a1f60922e1b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.632945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37759d-c923-4d92-b3b1-50f7395b02a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.633747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37759d-c923-4d92-b3b1-50f7395b02a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.634020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37759d-c923-4d92-b3b1-50f7395b02a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.634323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37759d-c923-4d92-b3b1-50f7395b02a6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.640145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7466661-0bbd-4c36-8ada-5a1f60922e1b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.644240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5422ceb-f206-48c5-a607-c30c0aeea1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.644862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5422ceb-f206-48c5-a607-c30c0aeea1ba admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.645134 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5422ceb-f206-48c5-a607-c30c0aeea1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.645434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5422ceb-f206-48c5-a607-c30c0aeea1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.646176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5422ceb-f206-48c5-a607-c30c0aeea1ba admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:45.646472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5422ceb-f206-48c5-a607-c30c0aeea1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.648019 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5422ceb-f206-48c5-a607-c30c0aeea1ba admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.649121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37759d-c923-4d92-b3b1-50f7395b02a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:45.656231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0b37759d-c923-4d92-b3b1-50f7395b02a6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:45.656349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 155/308] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:45.657021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5422ceb-f206-48c5-a607-c30c0aeea1ba admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.657476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 154/309] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:45.661915 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37759d-c923-4d92-b3b1-50f7395b02a6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.666670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5422ceb-f206-48c5-a607-c30c0aeea1ba admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.670946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955552f9-f913-4dce-b928-992afdda5eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.671742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955552f9-f913-4dce-b928-992afdda5eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.672016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955552f9-f913-4dce-b928-992afdda5eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.672281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955552f9-f913-4dce-b928-992afdda5eb7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.673497 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955552f9-f913-4dce-b928-992afdda5eb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.675205 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955552f9-f913-4dce-b928-992afdda5eb7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.676160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37759d-c923-4d92-b3b1-50f7395b02a6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.676817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 156/310] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:45.677648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955552f9-f913-4dce-b928-992afdda5eb7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.680745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d59dd-dfce-450d-8f24-65c453f98c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.681498 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d59dd-dfce-450d-8f24-65c453f98c76 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.681759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d59dd-dfce-450d-8f24-65c453f98c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.682033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d59dd-dfce-450d-8f24-65c453f98c76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.682882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d59dd-dfce-450d-8f24-65c453f98c76 admin admin] RBAC: Adding query filter params (role.id=c8891868ea2c4086af4903f6050eecc4, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab, user.id=c76e36757610429dbe281b1e9405e006) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:45.683192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d59dd-dfce-450d-8f24-65c453f98c76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.685160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d59dd-dfce-450d-8f24-65c453f98c76 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.687169 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955552f9-f913-4dce-b928-992afdda5eb7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.691391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bc017-de71-4117-aca6-4c13fce2c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.691550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 155/311] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/role_assignments?user.id=c76e36757610429dbe281b1e9405e006&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=c8891868ea2c4086af4903f6050eecc4 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:45.692212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bc017-de71-4117-aca6-4c13fce2c3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.692461 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d59dd-dfce-450d-8f24-65c453f98c76 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.692570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bc017-de71-4117-aca6-4c13fce2c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.692802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bc017-de71-4117-aca6-4c13fce2c3e6 admin admin] PATH_INFO: `/v3/users/2ee8a3bd395c4707a1fbe756609b4c41` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.705141 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d59dd-dfce-450d-8f24-65c453f98c76 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.711248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bc017-de71-4117-aca6-4c13fce2c3e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ee8a3bd395c4707a1fbe756609b4c41)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.712310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d086b0c-0a25-4cf7-9b00-23a84155fe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.712979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d086b0c-0a25-4cf7-9b00-23a84155fe0e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.713278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d086b0c-0a25-4cf7-9b00-23a84155fe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.713549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d086b0c-0a25-4cf7-9b00-23a84155fe0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.713842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bc017-de71-4117-aca6-4c13fce2c3e6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.714324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d086b0c-0a25-4cf7-9b00-23a84155fe0e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:45.714609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d086b0c-0a25-4cf7-9b00-23a84155fe0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.715911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 157/312] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/users/2ee8a3bd395c4707a1fbe756609b4c41 => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:45.716342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d086b0c-0a25-4cf7-9b00-23a84155fe0e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.721694 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bc017-de71-4117-aca6-4c13fce2c3e6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.726779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 156/313] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:45.727480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d086b0c-0a25-4cf7-9b00-23a84155fe0e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.732413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bc017-de71-4117-aca6-4c13fce2c3e6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.737112 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d086b0c-0a25-4cf7-9b00-23a84155fe0e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.737299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a95b-1487-4979-a63c-619c2c4449c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.737876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a95b-1487-4979-a63c-619c2c4449c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.738153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a95b-1487-4979-a63c-619c2c4449c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.738421 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a95b-1487-4979-a63c-619c2c4449c1 admin admin] PATH_INFO: `/v3/groups` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.739124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7a95b-1487-4979-a63c-619c2c4449c1 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.740170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-b1a7a95b-1487-4979-a63c-619c2c4449c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:45.740170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:12:45.740170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:12:45.741441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7a95b-1487-4979-a63c-619c2c4449c1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.741830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebbbfb-13c0-41d3-9a93-8107c1b2a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.742479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebbbfb-13c0-41d3-9a93-8107c1b2a4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.742751 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebbbfb-13c0-41d3-9a93-8107c1b2a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.743016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebbbfb-13c0-41d3-9a93-8107c1b2a4f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.743853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebbbfb-13c0-41d3-9a93-8107c1b2a4f0 admin admin] RBAC: Adding query filter params (role.id=c8891868ea2c4086af4903f6050eecc4, user.id=2ee8a3bd395c4707a1fbe756609b4c41, scope.system=all) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:45.744156 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebbbfb-13c0-41d3-9a93-8107c1b2a4f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.746069 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebbbfb-13c0-41d3-9a93-8107c1b2a4f0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.752911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 157/314] 10.222.0.16 () {56 vars in 1329 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/role_assignments?user.id=2ee8a3bd395c4707a1fbe756609b4c41&scope.system=all&role.id=c8891868ea2c4086af4903f6050eecc4 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:45.753634 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebbbfb-13c0-41d3-9a93-8107c1b2a4f0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.763778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebbbfb-13c0-41d3-9a93-8107c1b2a4f0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.765791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 158/315] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jan 28 01:12:45 2022] POST /identity/v3/groups => generated 229 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:12:45.768465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144c2c7-1bfb-4aac-acd2-e8700959d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.773555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144c2c7-1bfb-4aac-acd2-e8700959d138 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.773555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144c2c7-1bfb-4aac-acd2-e8700959d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.773555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144c2c7-1bfb-4aac-acd2-e8700959d138 admin admin] PATH_INFO: `/v3/users/64047af9c6804e1d967b8f143c401c66` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.775009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144c2c7-1bfb-4aac-acd2-e8700959d138 admin admin] RBAC: Authorizing `identity:get_user(user_id=64047af9c6804e1d967b8f143c401c66)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.777708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144c2c7-1bfb-4aac-acd2-e8700959d138 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.780094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 158/316] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:45 2022] GET /identity/v3/users/64047af9c6804e1d967b8f143c401c66 => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:45.786949 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a95b-1487-4979-a63c-619c2c4449c1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:45.798239 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a95b-1487-4979-a63c-619c2c4449c1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:45.803223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08f11e-6dee-4520-b03c-cbee2ba410fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:45.804240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08f11e-6dee-4520-b03c-cbee2ba410fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:45.804587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08f11e-6dee-4520-b03c-cbee2ba410fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:45.804922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08f11e-6dee-4520-b03c-cbee2ba410fd admin admin] PATH_INFO: `/v3/system/users/64047af9c6804e1d967b8f143c401c66/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:45.806788 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08f11e-6dee-4520-b03c-cbee2ba410fd admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=64047af9c6804e1d967b8f143c401c66, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:45.807956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-3d08f11e-6dee-4520-b03c-cbee2ba410fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:45.807956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:12:45.807956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:12:45.808963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08f11e-6dee-4520-b03c-cbee2ba410fd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:45.820764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 159/317] 10.222.0.16 () {58 vars in 1355 bytes} [Fri Jan 28 01:12:45 2022] PUT /identity/v3/system/users/64047af9c6804e1d967b8f143c401c66/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:48.003229 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957978c-2a9b-4414-801f-1ced8a28b71f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.003875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957978c-2a9b-4414-801f-1ced8a28b71f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.003875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957978c-2a9b-4414-801f-1ced8a28b71f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.006050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e510d-6b33-4100-a612-65aa6e0ebc0b None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.006464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 159/318] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:48.006650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e510d-6b33-4100-a612-65aa6e0ebc0b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.006917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e510d-6b33-4100-a612-65aa6e0ebc0b None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.008814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 160/319] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:48.013425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e77a-a98e-4b0e-bd78-9fd5c7a53792 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.013685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e77a-a98e-4b0e-bd78-9fd5c7a53792 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.013850 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a37542-7e76-4966-8430-84f1c3283ece None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.013940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e77a-a98e-4b0e-bd78-9fd5c7a53792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.014147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a37542-7e76-4966-8430-84f1c3283ece None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.014444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a37542-7e76-4966-8430-84f1c3283ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.031769 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ad46e77a-a98e-4b0e-bd78-9fd5c7a53792 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:48.032469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d9a37542-7e76-4966-8430-84f1c3283ece None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:48.032955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ad46e77a-a98e-4b0e-bd78-9fd5c7a53792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:48.033669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d9a37542-7e76-4966-8430-84f1c3283ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:48.040506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 160/320] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:48.041187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 161/321] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:48.063586 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e77a-a98e-4b0e-bd78-9fd5c7a53792 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:48.064864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a37542-7e76-4966-8430-84f1c3283ece None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:48.072687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e77a-a98e-4b0e-bd78-9fd5c7a53792 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:48.073767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a37542-7e76-4966-8430-84f1c3283ece None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:48.077000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58af78-1db9-424b-8d1f-a1bd4015da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:48.077803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58af78-1db9-424b-8d1f-a1bd4015da7e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.078028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274986b-9bca-402a-bd0b-bc7281f72801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:48.078132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58af78-1db9-424b-8d1f-a1bd4015da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.078328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58af78-1db9-424b-8d1f-a1bd4015da7e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.078834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274986b-9bca-402a-bd0b-bc7281f72801 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.079110 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274986b-9bca-402a-bd0b-bc7281f72801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.079379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274986b-9bca-402a-bd0b-bc7281f72801 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.079465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58af78-1db9-424b-8d1f-a1bd4015da7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:48.081111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58af78-1db9-424b-8d1f-a1bd4015da7e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:48.082831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 161/322] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:12:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:48.083783 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648c38d-1ee2-4bd9-b163-97b425c16666 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.084168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648c38d-1ee2-4bd9-b163-97b425c16666 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.084326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648c38d-1ee2-4bd9-b163-97b425c16666 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.086149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 162/323] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:48.087776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648c38d-1ee2-4bd9-b163-97b425c16666 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:48.090213 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274986b-9bca-402a-bd0b-bc7281f72801 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:48.097031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-a274986b-9bca-402a-bd0b-bc7281f72801 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 28 01:12:48.098555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 162/324] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:12:48.099764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648c38d-1ee2-4bd9-b163-97b425c16666 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:48.099866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8743f-67b4-491a-a550-bdd99cb06204 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.100059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8743f-67b4-491a-a550-bdd99cb06204 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.100349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8743f-67b4-491a-a550-bdd99cb06204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.103873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42f56e-7846-4e6b-84da-e374e4aeb434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:48.104490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f56e-7846-4e6b-84da-e374e4aeb434 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.104768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f56e-7846-4e6b-84da-e374e4aeb434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.105035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f56e-7846-4e6b-84da-e374e4aeb434 admin admin] PATH_INFO: `/v3/groups` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.105747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42f56e-7846-4e6b-84da-e374e4aeb434 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:48.107017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-0e42f56e-7846-4e6b-84da-e374e4aeb434 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:48.107017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:12:48.107017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:12:48.108044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42f56e-7846-4e6b-84da-e374e4aeb434 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:48.117862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-3bc8743f-67b4-491a-a550-bdd99cb06204 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:48.119006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3bc8743f-67b4-491a-a550-bdd99cb06204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:48.123869 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 163/325] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jan 28 01:12:48 2022] POST /identity/v3/groups => generated 226 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:12:48.124665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42f56e-7846-4e6b-84da-e374e4aeb434 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:48.126834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 163/326] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:48.143115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42f56e-7846-4e6b-84da-e374e4aeb434 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:48.147625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7db109-318d-4fae-ac5d-020e35886282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:48.148308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7db109-318d-4fae-ac5d-020e35886282 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.148584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7db109-318d-4fae-ac5d-020e35886282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.148851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7db109-318d-4fae-ac5d-020e35886282 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.149722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7db109-318d-4fae-ac5d-020e35886282 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:48.150026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7db109-318d-4fae-ac5d-020e35886282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:48.150567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8743f-67b4-491a-a550-bdd99cb06204 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:48.151629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7db109-318d-4fae-ac5d-020e35886282 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:48.159826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8743f-67b4-491a-a550-bdd99cb06204 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:48.161351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 164/327] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:48.164515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9916-4142-4c56-a71e-cabbfbccd577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:48.165404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9916-4142-4c56-a71e-cabbfbccd577 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.165640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9916-4142-4c56-a71e-cabbfbccd577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.165893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9916-4142-4c56-a71e-cabbfbccd577 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.166950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7db109-318d-4fae-ac5d-020e35886282 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:48.177533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec9916-4142-4c56-a71e-cabbfbccd577 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:48.178374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7db109-318d-4fae-ac5d-020e35886282 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:48.182935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc324b-a84b-4f6b-804f-3ad6277558f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:48.183808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc324b-a84b-4f6b-804f-3ad6277558f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.184282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc324b-a84b-4f6b-804f-3ad6277558f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.184412 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc324b-a84b-4f6b-804f-3ad6277558f3 admin admin] PATH_INFO: `/v3/users/2ee8a3bd395c4707a1fbe756609b4c41` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.184587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-58ec9916-4142-4c56-a71e-cabbfbccd577 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:48.185707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc324b-a84b-4f6b-804f-3ad6277558f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ee8a3bd395c4707a1fbe756609b4c41)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:48.190558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 164/328] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:12:48.190744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc324b-a84b-4f6b-804f-3ad6277558f3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:48.190744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 165/329] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:48 2022] GET /identity/v3/users/2ee8a3bd395c4707a1fbe756609b4c41 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:48.192716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9916-4142-4c56-a71e-cabbfbccd577 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:48.195019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc324b-a84b-4f6b-804f-3ad6277558f3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:48.203746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9916-4142-4c56-a71e-cabbfbccd577 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:48.204604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc324b-a84b-4f6b-804f-3ad6277558f3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:48.208245 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a66190-94a5-4fb1-bad5-4d971d485246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:48.208918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a66190-94a5-4fb1-bad5-4d971d485246 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.209085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521801e9-8815-49da-93dc-26971f733787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:48.209281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a66190-94a5-4fb1-bad5-4d971d485246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.209571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a66190-94a5-4fb1-bad5-4d971d485246 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.209965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521801e9-8815-49da-93dc-26971f733787 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.210241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521801e9-8815-49da-93dc-26971f733787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.210331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a66190-94a5-4fb1-bad5-4d971d485246 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:48.210506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521801e9-8815-49da-93dc-26971f733787 admin admin] PATH_INFO: `/v3/system/users/2ee8a3bd395c4707a1fbe756609b4c41/roles/c8891868ea2c4086af4903f6050eecc4` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.210599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a66190-94a5-4fb1-bad5-4d971d485246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:48.212045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521801e9-8815-49da-93dc-26971f733787 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2ee8a3bd395c4707a1fbe756609b4c41, role_id=c8891868ea2c4086af4903f6050eecc4)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:48.212210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a66190-94a5-4fb1-bad5-4d971d485246 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:48.213065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-521801e9-8815-49da-93dc-26971f733787 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:48.213065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:12:48.213065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:12:48.213962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521801e9-8815-49da-93dc-26971f733787 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:48.222582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 165/330] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:48.228388 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a66190-94a5-4fb1-bad5-4d971d485246 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:48.233055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 166/331] 10.222.0.16 () {58 vars in 1355 bytes} [Fri Jan 28 01:12:48 2022] PUT /identity/v3/system/users/2ee8a3bd395c4707a1fbe756609b4c41/roles/c8891868ea2c4086af4903f6050eecc4 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:12:48.238975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a66190-94a5-4fb1-bad5-4d971d485246 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:48.244374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdc3fc-8dab-4500-8bdf-f09811b47f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:48.245360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdc3fc-8dab-4500-8bdf-f09811b47f74 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.245634 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdc3fc-8dab-4500-8bdf-f09811b47f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.245961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdc3fc-8dab-4500-8bdf-f09811b47f74 admin admin] PATH_INFO: `/v3/users/64047af9c6804e1d967b8f143c401c66` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.247359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdc3fc-8dab-4500-8bdf-f09811b47f74 admin admin] RBAC: Authorizing `identity:get_user(user_id=64047af9c6804e1d967b8f143c401c66)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:48.249619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdc3fc-8dab-4500-8bdf-f09811b47f74 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:48.251714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 166/332] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:48 2022] GET /identity/v3/users/64047af9c6804e1d967b8f143c401c66 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:48.257947 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521801e9-8815-49da-93dc-26971f733787 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:48.269538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521801e9-8815-49da-93dc-26971f733787 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:48.274901 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fd8c0-0f6d-4d43-b5d8-d4edc248e421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:48.275696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fd8c0-0f6d-4d43-b5d8-d4edc248e421 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:48.276051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fd8c0-0f6d-4d43-b5d8-d4edc248e421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:48.276387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fd8c0-0f6d-4d43-b5d8-d4edc248e421 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:48.277399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fd8c0-0f6d-4d43-b5d8-d4edc248e421 admin admin] RBAC: Adding query filter params (role.id=726ccf812eba475187c3df7288e1d46b, user.id=64047af9c6804e1d967b8f143c401c66, scope.system=all) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:48.277777 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fd8c0-0f6d-4d43-b5d8-d4edc248e421 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:48.279867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fd8c0-0f6d-4d43-b5d8-d4edc248e421 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:48.298244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 167/333] 10.222.0.16 () {56 vars in 1329 bytes} [Fri Jan 28 01:12:48 2022] GET /identity/v3/role_assignments?user.id=64047af9c6804e1d967b8f143c401c66&scope.system=all&role.id=726ccf812eba475187c3df7288e1d46b => generated 510 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:50.710183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d9bc0-a530-4f71-bcdd-d749c6159285 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:50.710777 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d9bc0-a530-4f71-bcdd-d749c6159285 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:50.710777 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d9bc0-a530-4f71-bcdd-d749c6159285 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:50.712712 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 167/334] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:50.718588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f850df-316e-4e97-afe0-26d3cd6aa86f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:50.719396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f850df-316e-4e97-afe0-26d3cd6aa86f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:50.719888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f850df-316e-4e97-afe0-26d3cd6aa86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:50.740051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-37f850df-316e-4e97-afe0-26d3cd6aa86f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:50.741649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-37f850df-316e-4e97-afe0-26d3cd6aa86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:50.755330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 168/335] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:50.774605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a69209-fb8c-4ec0-ac58-4335c8e29fc1 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:50.774913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a69209-fb8c-4ec0-ac58-4335c8e29fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:50.775149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a69209-fb8c-4ec0-ac58-4335c8e29fc1 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:50.776928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 168/336] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:50.782779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854181b-fc01-4c4c-917f-c1daec347dde None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:50.783295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854181b-fc01-4c4c-917f-c1daec347dde None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:50.783774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854181b-fc01-4c4c-917f-c1daec347dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:50.794399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a69209-fb8c-4ec0-ac58-4335c8e29fc1 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:50.810308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2854181b-fc01-4c4c-917f-c1daec347dde None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:50.811419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a69209-fb8c-4ec0-ac58-4335c8e29fc1 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:50.812119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2854181b-fc01-4c4c-917f-c1daec347dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:50.815891 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80903539-1096-4010-bfa9-386b20ea17b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:50.816833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903539-1096-4010-bfa9-386b20ea17b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:50.817102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903539-1096-4010-bfa9-386b20ea17b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:50.817393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80903539-1096-4010-bfa9-386b20ea17b8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:50.833976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 169/337] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:50.841348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80903539-1096-4010-bfa9-386b20ea17b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:50.848866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-80903539-1096-4010-bfa9-386b20ea17b8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 28 01:12:50.850385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 169/338] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:50.856087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854181b-fc01-4c4c-917f-c1daec347dde None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:50.870138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854181b-fc01-4c4c-917f-c1daec347dde None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:50.876132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549d7b7-d02c-4399-ac33-cd71bf9725a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:50.877017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549d7b7-d02c-4399-ac33-cd71bf9725a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:50.877512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549d7b7-d02c-4399-ac33-cd71bf9725a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:50.878027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549d7b7-d02c-4399-ac33-cd71bf9725a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:50.878998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549d7b7-d02c-4399-ac33-cd71bf9725a2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:50.879505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549d7b7-d02c-4399-ac33-cd71bf9725a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:50.881352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549d7b7-d02c-4399-ac33-cd71bf9725a2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:50.892812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 170/339] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:50.898440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80903539-1096-4010-bfa9-386b20ea17b8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:50.910320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80903539-1096-4010-bfa9-386b20ea17b8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:50.911641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549d7b7-d02c-4399-ac33-cd71bf9725a2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:50.927122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bbf14-9e16-4262-bc29-6bba3321d615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:50.928405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bbf14-9e16-4262-bc29-6bba3321d615 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:50.928896 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bbf14-9e16-4262-bc29-6bba3321d615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:50.929466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bbf14-9e16-4262-bc29-6bba3321d615 admin admin] PATH_INFO: `/v3/users/2ee8a3bd395c4707a1fbe756609b4c41` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:50.932581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549d7b7-d02c-4399-ac33-cd71bf9725a2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:50.933749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bbf14-9e16-4262-bc29-6bba3321d615 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ee8a3bd395c4707a1fbe756609b4c41)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:50.936232 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bbf14-9e16-4262-bc29-6bba3321d615 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:50.944488 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 170/340] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:12:50 2022] GET /identity/v3/users/2ee8a3bd395c4707a1fbe756609b4c41 => generated 293 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:50.946199 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bbf14-9e16-4262-bc29-6bba3321d615 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:50.950068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc87ca-0a8b-41f1-bc3c-142fddd84384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:50.951217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc87ca-0a8b-41f1-bc3c-142fddd84384 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:50.955267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc87ca-0a8b-41f1-bc3c-142fddd84384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:50.955824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc87ca-0a8b-41f1-bc3c-142fddd84384 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:50.967202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bbf14-9e16-4262-bc29-6bba3321d615 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:50.982038 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc87ca-0a8b-41f1-bc3c-142fddd84384 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:50.982993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b525e64-a6e8-4bb3-9d06-d36d1a2dec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:50.987398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b525e64-a6e8-4bb3-9d06-d36d1a2dec1d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:50.987928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b525e64-a6e8-4bb3-9d06-d36d1a2dec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:50.988429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b525e64-a6e8-4bb3-9d06-d36d1a2dec1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:50.989512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b525e64-a6e8-4bb3-9d06-d36d1a2dec1d admin admin] RBAC: Adding query filter params (role.id=c8891868ea2c4086af4903f6050eecc4, user.id=2ee8a3bd395c4707a1fbe756609b4c41, scope.system=all) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:50.990018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b525e64-a6e8-4bb3-9d06-d36d1a2dec1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:50.992057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b525e64-a6e8-4bb3-9d06-d36d1a2dec1d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:50.999180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-33bc87ca-0a8b-41f1-bc3c-142fddd84384 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:50.999180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 171/341] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:51.004597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc87ca-0a8b-41f1-bc3c-142fddd84384 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.014001 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 171/342] 10.222.0.16 () {56 vars in 1329 bytes} [Fri Jan 28 01:12:50 2022] GET /identity/v3/role_assignments?user.id=2ee8a3bd395c4707a1fbe756609b4c41&scope.system=all&role.id=c8891868ea2c4086af4903f6050eecc4 => generated 510 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:51.025118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc87ca-0a8b-41f1-bc3c-142fddd84384 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.039601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b0340-da73-43fe-9eb4-bf77049e0796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.040280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b0340-da73-43fe-9eb4-bf77049e0796 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.040556 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b0340-da73-43fe-9eb4-bf77049e0796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.040825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b0340-da73-43fe-9eb4-bf77049e0796 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.041628 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b0340-da73-43fe-9eb4-bf77049e0796 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:51.041931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b0340-da73-43fe-9eb4-bf77049e0796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.043646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b0340-da73-43fe-9eb4-bf77049e0796 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.061363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 172/343] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:51.066625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b525e64-a6e8-4bb3-9d06-d36d1a2dec1d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.078601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b525e64-a6e8-4bb3-9d06-d36d1a2dec1d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.094096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d25b-71e2-442c-a0b5-30e9f1bb5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.095157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d25b-71e2-442c-a0b5-30e9f1bb5f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.095628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d25b-71e2-442c-a0b5-30e9f1bb5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.096086 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d25b-71e2-442c-a0b5-30e9f1bb5f27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.105613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3d25b-71e2-442c-a0b5-30e9f1bb5f27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.107834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3d25b-71e2-442c-a0b5-30e9f1bb5f27 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.127618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 172/344] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:51.129152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b0340-da73-43fe-9eb4-bf77049e0796 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.151988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b0340-da73-43fe-9eb4-bf77049e0796 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.161928 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c52b66-cf66-4ed3-a54d-de610dbeee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.162930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c52b66-cf66-4ed3-a54d-de610dbeee51 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.163211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c52b66-cf66-4ed3-a54d-de610dbeee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.163488 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c52b66-cf66-4ed3-a54d-de610dbeee51 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.164935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c52b66-cf66-4ed3-a54d-de610dbeee51 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.167263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c52b66-cf66-4ed3-a54d-de610dbeee51 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.173698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 173/345] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:51.178849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d25b-71e2-442c-a0b5-30e9f1bb5f27 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.188569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d25b-71e2-442c-a0b5-30e9f1bb5f27 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.197482 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0162dda-dc0a-46df-8186-1b194c577db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.198711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0162dda-dc0a-46df-8186-1b194c577db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.199185 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0162dda-dc0a-46df-8186-1b194c577db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.199742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0162dda-dc0a-46df-8186-1b194c577db2 admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.212202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0162dda-dc0a-46df-8186-1b194c577db2 admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.213461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-c0162dda-dc0a-46df-8186-1b194c577db2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:51.213461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:12:51.213461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:12:51.214658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0162dda-dc0a-46df-8186-1b194c577db2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.216834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 173/346] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:51.222476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c52b66-cf66-4ed3-a54d-de610dbeee51 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.238723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c52b66-cf66-4ed3-a54d-de610dbeee51 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.245463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acbd1c-3ab0-4296-965a-49b8746d2cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.246126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acbd1c-3ab0-4296-965a-49b8746d2cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.246399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acbd1c-3ab0-4296-965a-49b8746d2cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.246723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acbd1c-3ab0-4296-965a-49b8746d2cd8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.247579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acbd1c-3ab0-4296-965a-49b8746d2cd8 admin admin] RBAC: Adding query filter params (group.id=a8335b25dd8e40bb8c6464cb9e461085, role.id=726ccf812eba475187c3df7288e1d46b, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:51.247883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acbd1c-3ab0-4296-965a-49b8746d2cd8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.249771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acbd1c-3ab0-4296-965a-49b8746d2cd8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.258140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 174/347] 10.222.0.16 () {56 vars in 1397 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/role_assignments?group.id=a8335b25dd8e40bb8c6464cb9e461085&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=726ccf812eba475187c3df7288e1d46b => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:51.321737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d46080-7234-44a1-8bef-0f671095e263 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.322052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d46080-7234-44a1-8bef-0f671095e263 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.322296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d46080-7234-44a1-8bef-0f671095e263 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.324445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 174/348] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:51.330027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e5719-efc7-4ab1-9075-128a31ad2150 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.330351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e5719-efc7-4ab1-9075-128a31ad2150 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.330569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e5719-efc7-4ab1-9075-128a31ad2150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.358358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b21e5719-efc7-4ab1-9075-128a31ad2150 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:51.359608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b21e5719-efc7-4ab1-9075-128a31ad2150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:51.367426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 175/349] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:51.402949 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d46080-7234-44a1-8bef-0f671095e263 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.419154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d46080-7234-44a1-8bef-0f671095e263 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.429493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33179518-cac5-4a06-9f7e-638501bf5e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.430309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33179518-cac5-4a06-9f7e-638501bf5e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.430587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33179518-cac5-4a06-9f7e-638501bf5e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.430858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33179518-cac5-4a06-9f7e-638501bf5e2b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.450329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33179518-cac5-4a06-9f7e-638501bf5e2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:51.457681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-33179518-cac5-4a06-9f7e-638501bf5e2b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:51.461455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 175/350] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:51.464946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e5719-efc7-4ab1-9075-128a31ad2150 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.478851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e5719-efc7-4ab1-9075-128a31ad2150 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.490584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f73419-3bef-47ca-9a5b-ec50e0c63083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.491266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f73419-3bef-47ca-9a5b-ec50e0c63083 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.491542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f73419-3bef-47ca-9a5b-ec50e0c63083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.491814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f73419-3bef-47ca-9a5b-ec50e0c63083 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.492583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f73419-3bef-47ca-9a5b-ec50e0c63083 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:51.492881 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f73419-3bef-47ca-9a5b-ec50e0c63083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.494532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f73419-3bef-47ca-9a5b-ec50e0c63083 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.500873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322328c3-dd09-4263-b315-623f0859e26c None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.502800 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322328c3-dd09-4263-b315-623f0859e26c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.503499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322328c3-dd09-4263-b315-623f0859e26c None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.507238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 176/351] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:51.511550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 176/352] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:51.516720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322328c3-dd09-4263-b315-623f0859e26c None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.533262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e674ecd-59b5-45f7-b9f6-94eb5ca85089 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.533262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e674ecd-59b5-45f7-b9f6-94eb5ca85089 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.533262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e674ecd-59b5-45f7-b9f6-94eb5ca85089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.534438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322328c3-dd09-4263-b315-623f0859e26c None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.541953 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edaa6-330c-49a9-8020-467c5e1cf020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.542968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edaa6-330c-49a9-8020-467c5e1cf020 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.543551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edaa6-330c-49a9-8020-467c5e1cf020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.544041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edaa6-330c-49a9-8020-467c5e1cf020 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.552872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01edaa6-330c-49a9-8020-467c5e1cf020 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.555011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01edaa6-330c-49a9-8020-467c5e1cf020 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.558321 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0e674ecd-59b5-45f7-b9f6-94eb5ca85089 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:51.559809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0e674ecd-59b5-45f7-b9f6-94eb5ca85089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:51.568409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 177/353] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:51.573866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edaa6-330c-49a9-8020-467c5e1cf020 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.578783 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 177/354] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:51.600119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edaa6-330c-49a9-8020-467c5e1cf020 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.607432 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e674ecd-59b5-45f7-b9f6-94eb5ca85089 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.619655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991e5c1-e986-44c8-81bd-eb015c6808b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.620917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991e5c1-e986-44c8-81bd-eb015c6808b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.621939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991e5c1-e986-44c8-81bd-eb015c6808b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.628920 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991e5c1-e986-44c8-81bd-eb015c6808b7 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.631957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991e5c1-e986-44c8-81bd-eb015c6808b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.635744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991e5c1-e986-44c8-81bd-eb015c6808b7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.639633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e674ecd-59b5-45f7-b9f6-94eb5ca85089 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.640845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 178/355] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:51.646456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991e5c1-e986-44c8-81bd-eb015c6808b7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.653442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95990299-0b51-4467-8ebd-ed1c55d458b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.654731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95990299-0b51-4467-8ebd-ed1c55d458b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.655221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95990299-0b51-4467-8ebd-ed1c55d458b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.656319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95990299-0b51-4467-8ebd-ed1c55d458b5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.659888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991e5c1-e986-44c8-81bd-eb015c6808b7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.668780 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6dcc-f79c-4942-bdee-7c00c1c94fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.669704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6dcc-f79c-4942-bdee-7c00c1c94fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.669979 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6dcc-f79c-4942-bdee-7c00c1c94fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.670248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6dcc-f79c-4942-bdee-7c00c1c94fe9 admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.673977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f6dcc-f79c-4942-bdee-7c00c1c94fe9 admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.675876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f6dcc-f79c-4942-bdee-7c00c1c94fe9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.677035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95990299-0b51-4467-8ebd-ed1c55d458b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:51.677895 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 179/356] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:51.683126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6dcc-f79c-4942-bdee-7c00c1c94fe9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.686573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-95990299-0b51-4467-8ebd-ed1c55d458b5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:51.692831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 178/357] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:51.696351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95990299-0b51-4467-8ebd-ed1c55d458b5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.698475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6dcc-f79c-4942-bdee-7c00c1c94fe9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.709928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab407e7-cade-4f28-a3f2-33872a0aa8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.710432 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95990299-0b51-4467-8ebd-ed1c55d458b5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.710607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab407e7-cade-4f28-a3f2-33872a0aa8bb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.711045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab407e7-cade-4f28-a3f2-33872a0aa8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.711138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab407e7-cade-4f28-a3f2-33872a0aa8bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.711961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab407e7-cade-4f28-a3f2-33872a0aa8bb admin admin] RBAC: Adding query filter params (group.id=a8335b25dd8e40bb8c6464cb9e461085, role.id=726ccf812eba475187c3df7288e1d46b, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:51.712275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab407e7-cade-4f28-a3f2-33872a0aa8bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.714343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab407e7-cade-4f28-a3f2-33872a0aa8bb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.718644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ecaa2-bb95-4be2-b40e-6b8a6d2a2d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.720014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ecaa2-bb95-4be2-b40e-6b8a6d2a2d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.720584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ecaa2-bb95-4be2-b40e-6b8a6d2a2d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.721073 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ecaa2-bb95-4be2-b40e-6b8a6d2a2d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.722129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ecaa2-bb95-4be2-b40e-6b8a6d2a2d4b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:51.725318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 180/358] 10.222.0.16 () {56 vars in 1397 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/role_assignments?group.id=a8335b25dd8e40bb8c6464cb9e461085&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=726ccf812eba475187c3df7288e1d46b => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:51.725471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ecaa2-bb95-4be2-b40e-6b8a6d2a2d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.725471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ecaa2-bb95-4be2-b40e-6b8a6d2a2d4b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.743949 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 179/359] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:51.749162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab407e7-cade-4f28-a3f2-33872a0aa8bb admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.761989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab407e7-cade-4f28-a3f2-33872a0aa8bb admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.767015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ba4ae-46e6-42f0-8db1-b0aaa0baa944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.768003 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ba4ae-46e6-42f0-8db1-b0aaa0baa944 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.768477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ba4ae-46e6-42f0-8db1-b0aaa0baa944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.769745 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ba4ae-46e6-42f0-8db1-b0aaa0baa944 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.778897 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ba4ae-46e6-42f0-8db1-b0aaa0baa944 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.781041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ba4ae-46e6-42f0-8db1-b0aaa0baa944 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.796031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 181/360] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:51.797853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ecaa2-bb95-4be2-b40e-6b8a6d2a2d4b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.808502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ecaa2-bb95-4be2-b40e-6b8a6d2a2d4b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.813622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c754861-96c9-4db9-ade9-4812987aa016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.814909 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754861-96c9-4db9-ade9-4812987aa016 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.815388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754861-96c9-4db9-ade9-4812987aa016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.815857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754861-96c9-4db9-ade9-4812987aa016 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.817485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c754861-96c9-4db9-ade9-4812987aa016 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.819917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c754861-96c9-4db9-ade9-4812987aa016 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.825363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 180/361] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:51.828382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ba4ae-46e6-42f0-8db1-b0aaa0baa944 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.840743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ba4ae-46e6-42f0-8db1-b0aaa0baa944 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.845911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2a44c-671e-416b-bed5-c357d8100202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.847113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2a44c-671e-416b-bed5-c357d8100202 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.847588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2a44c-671e-416b-bed5-c357d8100202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.848387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2a44c-671e-416b-bed5-c357d8100202 admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.849965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2a44c-671e-416b-bed5-c357d8100202 admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.852159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2a44c-671e-416b-bed5-c357d8100202 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.859655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 182/362] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:51.861443 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c754861-96c9-4db9-ade9-4812987aa016 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:51.872389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c754861-96c9-4db9-ade9-4812987aa016 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:51.877835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df367d9-7388-4476-97eb-1e6c6ef94aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:51.878898 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df367d9-7388-4476-97eb-1e6c6ef94aec admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:51.879405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df367d9-7388-4476-97eb-1e6c6ef94aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:51.879944 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df367d9-7388-4476-97eb-1e6c6ef94aec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:51.881013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df367d9-7388-4476-97eb-1e6c6ef94aec admin admin] RBAC: Adding query filter params (group.id=a8335b25dd8e40bb8c6464cb9e461085, role.id=7cc6510c2843471b8db1852425803574, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:51.881610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df367d9-7388-4476-97eb-1e6c6ef94aec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:51.883791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df367d9-7388-4476-97eb-1e6c6ef94aec admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:51.897422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 181/363] 10.222.0.16 () {56 vars in 1397 bytes} [Fri Jan 28 01:12:51 2022] GET /identity/v3/role_assignments?group.id=a8335b25dd8e40bb8c6464cb9e461085&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=7cc6510c2843471b8db1852425803574 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:52.324830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca15e-5bdd-4e44-84a8-8d70f413c120 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:52.325541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca15e-5bdd-4e44-84a8-8d70f413c120 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:52.326022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca15e-5bdd-4e44-84a8-8d70f413c120 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:52.328418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 183/364] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:52.338879 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d208d-0f11-43ea-aa4a-76fee0fdba8f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:52.339446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d208d-0f11-43ea-aa4a-76fee0fdba8f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:52.339931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d208d-0f11-43ea-aa4a-76fee0fdba8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:52.361039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-843d208d-0f11-43ea-aa4a-76fee0fdba8f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:52.362578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-843d208d-0f11-43ea-aa4a-76fee0fdba8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:52.372975 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 182/365] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:52.398527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca15e-5bdd-4e44-84a8-8d70f413c120 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:52.412744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca15e-5bdd-4e44-84a8-8d70f413c120 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:52.417509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547c28c-ccd1-4b60-9fe9-7c5dc725b152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:52.418593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547c28c-ccd1-4b60-9fe9-7c5dc725b152 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:52.419091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547c28c-ccd1-4b60-9fe9-7c5dc725b152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:52.419556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547c28c-ccd1-4b60-9fe9-7c5dc725b152 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:52.432794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547c28c-ccd1-4b60-9fe9-7c5dc725b152 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:52.440522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-0547c28c-ccd1-4b60-9fe9-7c5dc725b152 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:52.442370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 184/366] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:52.450707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d208d-0f11-43ea-aa4a-76fee0fdba8f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:52.460101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d208d-0f11-43ea-aa4a-76fee0fdba8f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:52.464814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ab8a-7e74-43f8-b4b1-c0af0403f1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:52.465795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ab8a-7e74-43f8-b4b1-c0af0403f1ab admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:52.466284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ab8a-7e74-43f8-b4b1-c0af0403f1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:52.466764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ab8a-7e74-43f8-b4b1-c0af0403f1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:52.467775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393ab8a-7e74-43f8-b4b1-c0af0403f1ab admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:52.468267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393ab8a-7e74-43f8-b4b1-c0af0403f1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:52.470160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393ab8a-7e74-43f8-b4b1-c0af0403f1ab admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:52.481999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 183/367] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:52.487599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547c28c-ccd1-4b60-9fe9-7c5dc725b152 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:52.501324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547c28c-ccd1-4b60-9fe9-7c5dc725b152 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:52.506264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629fedc-b1c7-4b15-a71b-71f6031d5bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:52.507117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629fedc-b1c7-4b15-a71b-71f6031d5bfd admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:52.507601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629fedc-b1c7-4b15-a71b-71f6031d5bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:52.508114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629fedc-b1c7-4b15-a71b-71f6031d5bfd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:52.521036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629fedc-b1c7-4b15-a71b-71f6031d5bfd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:52.523141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629fedc-b1c7-4b15-a71b-71f6031d5bfd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:52.534800 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 185/368] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:52.540409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ab8a-7e74-43f8-b4b1-c0af0403f1ab admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:52.554277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ab8a-7e74-43f8-b4b1-c0af0403f1ab admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:52.561835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347f92-6991-473f-9e5f-5ecd10849155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:52.562698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347f92-6991-473f-9e5f-5ecd10849155 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:52.562980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347f92-6991-473f-9e5f-5ecd10849155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:52.563248 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347f92-6991-473f-9e5f-5ecd10849155 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:52.569989 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec347f92-6991-473f-9e5f-5ecd10849155 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:52.572040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec347f92-6991-473f-9e5f-5ecd10849155 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:52.573979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 184/369] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:52 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:52.579325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629fedc-b1c7-4b15-a71b-71f6031d5bfd admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:52.589810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629fedc-b1c7-4b15-a71b-71f6031d5bfd admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:52.596438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52f3f7-2759-42d1-bd03-ff86e1f21b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:52.597558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52f3f7-2759-42d1-bd03-ff86e1f21b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:52.598374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52f3f7-2759-42d1-bd03-ff86e1f21b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:52.598901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52f3f7-2759-42d1-bd03-ff86e1f21b54 admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:52.601135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52f3f7-2759-42d1-bd03-ff86e1f21b54 admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:52.603311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52f3f7-2759-42d1-bd03-ff86e1f21b54 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:52.605140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 186/370] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:52 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:52.611402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347f92-6991-473f-9e5f-5ecd10849155 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:52.626352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347f92-6991-473f-9e5f-5ecd10849155 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:52.638395 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d42c7-67f0-42b0-a2c4-08a1176b9976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:52.639093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d42c7-67f0-42b0-a2c4-08a1176b9976 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:52.639350 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d42c7-67f0-42b0-a2c4-08a1176b9976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:52.639619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d42c7-67f0-42b0-a2c4-08a1176b9976 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:52.640472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d42c7-67f0-42b0-a2c4-08a1176b9976 admin admin] RBAC: Adding query filter params (group.id=a8335b25dd8e40bb8c6464cb9e461085, role.id=7cc6510c2843471b8db1852425803574, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:52.640779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d42c7-67f0-42b0-a2c4-08a1176b9976 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:52.642652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d42c7-67f0-42b0-a2c4-08a1176b9976 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:52.653645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 185/371] 10.222.0.16 () {56 vars in 1397 bytes} [Fri Jan 28 01:12:52 2022] GET /identity/v3/role_assignments?group.id=a8335b25dd8e40bb8c6464cb9e461085&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=7cc6510c2843471b8db1852425803574 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:53.552839 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af8c8-49ee-474b-b02a-2e364545c35b None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:53.553441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af8c8-49ee-474b-b02a-2e364545c35b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:53.553441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74af8c8-49ee-474b-b02a-2e364545c35b None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:53.555451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 187/372] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:53.561213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e1038-6dce-493a-9e07-59600f15518c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:53.561671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e1038-6dce-493a-9e07-59600f15518c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:53.561759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e1038-6dce-493a-9e07-59600f15518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:53.584951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1c9e1038-6dce-493a-9e07-59600f15518c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:53.586284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1c9e1038-6dce-493a-9e07-59600f15518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:53.600100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 186/373] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:53.635975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74af8c8-49ee-474b-b02a-2e364545c35b None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:53.658938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74af8c8-49ee-474b-b02a-2e364545c35b None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:53.666694 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f5ee8-132f-45ce-82bf-e552a36f9cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:53.667492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f5ee8-132f-45ce-82bf-e552a36f9cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:53.667761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f5ee8-132f-45ce-82bf-e552a36f9cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:53.668022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f5ee8-132f-45ce-82bf-e552a36f9cf8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:53.682108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f5ee8-132f-45ce-82bf-e552a36f9cf8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:53.689270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-d25f5ee8-132f-45ce-82bf-e552a36f9cf8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:53.690771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 188/374] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:53.696472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e1038-6dce-493a-9e07-59600f15518c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:53.706206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e1038-6dce-493a-9e07-59600f15518c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:53.714368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5755d-b8ee-4bc8-b8ca-dadfa206bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:53.715034 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5755d-b8ee-4bc8-b8ca-dadfa206bde1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:53.715423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5755d-b8ee-4bc8-b8ca-dadfa206bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:53.715703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5755d-b8ee-4bc8-b8ca-dadfa206bde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:53.716515 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5755d-b8ee-4bc8-b8ca-dadfa206bde1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:53.716815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5755d-b8ee-4bc8-b8ca-dadfa206bde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:53.718428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5755d-b8ee-4bc8-b8ca-dadfa206bde1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:53.732879 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 187/375] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:53.738407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f5ee8-132f-45ce-82bf-e552a36f9cf8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:53.748556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f5ee8-132f-45ce-82bf-e552a36f9cf8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:53.755074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d5d2a-6d67-4aef-8e70-4d938c953252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:53.755721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d5d2a-6d67-4aef-8e70-4d938c953252 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:53.755991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d5d2a-6d67-4aef-8e70-4d938c953252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:53.756261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d5d2a-6d67-4aef-8e70-4d938c953252 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:53.771024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d5d2a-6d67-4aef-8e70-4d938c953252 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:53.772839 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d5d2a-6d67-4aef-8e70-4d938c953252 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:53.787503 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 189/376] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:53.793425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5755d-b8ee-4bc8-b8ca-dadfa206bde1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:53.806264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5755d-b8ee-4bc8-b8ca-dadfa206bde1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:53.813821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd58c0-6d67-4055-9e4a-2e080bbcb658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:53.814679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd58c0-6d67-4055-9e4a-2e080bbcb658 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:53.814953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd58c0-6d67-4055-9e4a-2e080bbcb658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:53.815219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd58c0-6d67-4055-9e4a-2e080bbcb658 admin admin] PATH_INFO: `/v3/projects/890dca85d3164528880613bf0afcbf95` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:53.816432 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd58c0-6d67-4055-9e4a-2e080bbcb658 admin admin] RBAC: Authorizing `identity:get_project(project_id=890dca85d3164528880613bf0afcbf95)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:53.818317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd58c0-6d67-4055-9e4a-2e080bbcb658 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:53.820283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 188/377] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:53 2022] GET /identity/v3/projects/890dca85d3164528880613bf0afcbf95 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:53.825761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d5d2a-6d67-4aef-8e70-4d938c953252 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:53.834778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d5d2a-6d67-4aef-8e70-4d938c953252 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:53.841404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1842e21-3e3b-4696-9205-fbcacd4724bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:53.842254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842e21-3e3b-4696-9205-fbcacd4724bb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:53.842528 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842e21-3e3b-4696-9205-fbcacd4724bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:53.842791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1842e21-3e3b-4696-9205-fbcacd4724bb admin admin] PATH_INFO: `/v3/groups/6ebc7082aef54895be6b2316db794d34` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:53.853908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1842e21-3e3b-4696-9205-fbcacd4724bb admin admin] RBAC: Authorizing `identity:get_group(group_id=6ebc7082aef54895be6b2316db794d34)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:53.855830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1842e21-3e3b-4696-9205-fbcacd4724bb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:53.857590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 190/378] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:53 2022] GET /identity/v3/groups/6ebc7082aef54895be6b2316db794d34 => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:53.863348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd58c0-6d67-4055-9e4a-2e080bbcb658 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:53.878393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd58c0-6d67-4055-9e4a-2e080bbcb658 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:53.882976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f110f-239c-4fa8-81ce-ae20f43c8e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:53.883622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f110f-239c-4fa8-81ce-ae20f43c8e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:53.883955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f110f-239c-4fa8-81ce-ae20f43c8e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:53.884241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f110f-239c-4fa8-81ce-ae20f43c8e04 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:53.885131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f110f-239c-4fa8-81ce-ae20f43c8e04 admin admin] RBAC: Adding query filter params (group.id=6ebc7082aef54895be6b2316db794d34, role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=890dca85d3164528880613bf0afcbf95) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:53.885486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f110f-239c-4fa8-81ce-ae20f43c8e04 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:53.887363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f110f-239c-4fa8-81ce-ae20f43c8e04 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:53.897842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 189/379] 10.222.0.16 () {56 vars in 1397 bytes} [Fri Jan 28 01:12:53 2022] GET /identity/v3/role_assignments?group.id=6ebc7082aef54895be6b2316db794d34&scope.project.id=890dca85d3164528880613bf0afcbf95&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:54.036481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286d7eb-960e-4757-a39d-5291e982027d None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.036829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286d7eb-960e-4757-a39d-5291e982027d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.036998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286d7eb-960e-4757-a39d-5291e982027d None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.038827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 191/380] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:54.044817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312d61a-5d8b-45a4-a039-0fe5e3776202 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.045095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312d61a-5d8b-45a4-a039-0fe5e3776202 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.045409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312d61a-5d8b-45a4-a039-0fe5e3776202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.066100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1312d61a-5d8b-45a4-a039-0fe5e3776202 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:54.067234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1312d61a-5d8b-45a4-a039-0fe5e3776202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:54.075688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 190/381] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:54.100326 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286d7eb-960e-4757-a39d-5291e982027d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.114130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286d7eb-960e-4757-a39d-5291e982027d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.118708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b093-6111-49de-814d-e67842402edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.119522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b093-6111-49de-814d-e67842402edc admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.119793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b093-6111-49de-814d-e67842402edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.120063 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b093-6111-49de-814d-e67842402edc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.131589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2b093-6111-49de-814d-e67842402edc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:54.138776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-10f2b093-6111-49de-814d-e67842402edc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:54.140464 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 192/382] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:54.146302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312d61a-5d8b-45a4-a039-0fe5e3776202 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.155697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312d61a-5d8b-45a4-a039-0fe5e3776202 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.160562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019adab-e23a-4263-a9b1-a6ec0901c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.161279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019adab-e23a-4263-a9b1-a6ec0901c193 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.161566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019adab-e23a-4263-a9b1-a6ec0901c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.161841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019adab-e23a-4263-a9b1-a6ec0901c193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.162633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019adab-e23a-4263-a9b1-a6ec0901c193 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:54.162938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019adab-e23a-4263-a9b1-a6ec0901c193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:54.164574 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019adab-e23a-4263-a9b1-a6ec0901c193 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:54.174653 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 191/383] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:54.180608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b093-6111-49de-814d-e67842402edc admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.191459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b093-6111-49de-814d-e67842402edc admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.196122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957da1f6-1c48-4ff2-aac9-4dce176008fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.196994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957da1f6-1c48-4ff2-aac9-4dce176008fd admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.197305 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957da1f6-1c48-4ff2-aac9-4dce176008fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.197586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957da1f6-1c48-4ff2-aac9-4dce176008fd admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.198824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957da1f6-1c48-4ff2-aac9-4dce176008fd admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:54.201002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957da1f6-1c48-4ff2-aac9-4dce176008fd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:54.203002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 193/384] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:54 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:54.208759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019adab-e23a-4263-a9b1-a6ec0901c193 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.219616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019adab-e23a-4263-a9b1-a6ec0901c193 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.226315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c4bb1-3339-4bc2-a498-ef22fc0bf850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.227190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c4bb1-3339-4bc2-a498-ef22fc0bf850 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.227470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c4bb1-3339-4bc2-a498-ef22fc0bf850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.227749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c4bb1-3339-4bc2-a498-ef22fc0bf850 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.228983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c4bb1-3339-4bc2-a498-ef22fc0bf850 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:54.231153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c4bb1-3339-4bc2-a498-ef22fc0bf850 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:54.233884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 192/385] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:54 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:54.239925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957da1f6-1c48-4ff2-aac9-4dce176008fd admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.255537 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957da1f6-1c48-4ff2-aac9-4dce176008fd admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.266652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75df3d-dd63-4ea4-a096-0097ab815016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.266652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75df3d-dd63-4ea4-a096-0097ab815016 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.266652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75df3d-dd63-4ea4-a096-0097ab815016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.266652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75df3d-dd63-4ea4-a096-0097ab815016 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/groups/a8335b25dd8e40bb8c6464cb9e461085/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.269119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75df3d-dd63-4ea4-a096-0097ab815016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d55db5bd2549ce81113a761b93b5f7, group_id=a8335b25dd8e40bb8c6464cb9e461085, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:54.271811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75df3d-dd63-4ea4-a096-0097ab815016 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:54.292557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 194/386] 10.222.0.16 () {58 vars in 1463 bytes} [Fri Jan 28 01:12:54 2022] PUT /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/groups/a8335b25dd8e40bb8c6464cb9e461085/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:54.637446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d48555-1d25-4d2a-9598-4d9d5ba67885 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.638049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d48555-1d25-4d2a-9598-4d9d5ba67885 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.638049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d48555-1d25-4d2a-9598-4d9d5ba67885 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.640054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 193/387] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:54.644998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae374a-72f6-4daf-81ee-14c4ca1bba67 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.645532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae374a-72f6-4daf-81ee-14c4ca1bba67 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.645691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae374a-72f6-4daf-81ee-14c4ca1bba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.664943 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-95ae374a-72f6-4daf-81ee-14c4ca1bba67 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:54.666156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-95ae374a-72f6-4daf-81ee-14c4ca1bba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:54.732728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 195/388] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:54.766798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d48555-1d25-4d2a-9598-4d9d5ba67885 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.787106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d48555-1d25-4d2a-9598-4d9d5ba67885 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.795280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf93bd-ae21-46ba-b2d9-2dc0228e957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.796071 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf93bd-ae21-46ba-b2d9-2dc0228e957b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.796348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf93bd-ae21-46ba-b2d9-2dc0228e957b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.796620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf93bd-ae21-46ba-b2d9-2dc0228e957b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.811106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf93bd-ae21-46ba-b2d9-2dc0228e957b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:54.817938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-08bf93bd-ae21-46ba-b2d9-2dc0228e957b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:54.819140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 194/389] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:54.824824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40efde-22bf-47da-ab6c-95ecbe1ec0b6 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.825114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40efde-22bf-47da-ab6c-95ecbe1ec0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.825366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf93bd-ae21-46ba-b2d9-2dc0228e957b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.825538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40efde-22bf-47da-ab6c-95ecbe1ec0b6 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.827881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 196/390] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:54.833500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11960198-5670-41a6-b3a2-334f79323fe7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.833718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11960198-5670-41a6-b3a2-334f79323fe7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.833886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11960198-5670-41a6-b3a2-334f79323fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.840866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf93bd-ae21-46ba-b2d9-2dc0228e957b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.851307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef48a6-00f9-4c58-ad1c-198602a01ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.851970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef48a6-00f9-4c58-ad1c-198602a01ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.852250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef48a6-00f9-4c58-ad1c-198602a01ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.852519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef48a6-00f9-4c58-ad1c-198602a01ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.853307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef48a6-00f9-4c58-ad1c-198602a01ad2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:54.853612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef48a6-00f9-4c58-ad1c-198602a01ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:54.854709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-11960198-5670-41a6-b3a2-334f79323fe7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:54.855194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef48a6-00f9-4c58-ad1c-198602a01ad2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:54.856097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-11960198-5670-41a6-b3a2-334f79323fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:54.869490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 197/391] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:54.872447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 195/392] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:54.878976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11960198-5670-41a6-b3a2-334f79323fe7 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.888949 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11960198-5670-41a6-b3a2-334f79323fe7 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.893527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe671ce4-578c-44ee-9a2e-715a5325f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.894434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe671ce4-578c-44ee-9a2e-715a5325f774 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.894713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe671ce4-578c-44ee-9a2e-715a5325f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.894978 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe671ce4-578c-44ee-9a2e-715a5325f774 admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.896169 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe671ce4-578c-44ee-9a2e-715a5325f774 admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:54.898183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe671ce4-578c-44ee-9a2e-715a5325f774 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:54.899796 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 198/393] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:54 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:54.905467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef48a6-00f9-4c58-ad1c-198602a01ad2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.908329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe671ce4-578c-44ee-9a2e-715a5325f774 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.915569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef48a6-00f9-4c58-ad1c-198602a01ad2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.919084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe671ce4-578c-44ee-9a2e-715a5325f774 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.924304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299fbdc-f742-447d-9c87-e539520f1885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.925458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299fbdc-f742-447d-9c87-e539520f1885 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.926094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299fbdc-f742-447d-9c87-e539520f1885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.926628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299fbdc-f742-447d-9c87-e539520f1885 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.929575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0dbba-94d2-446f-8581-c60d40d1b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.930599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0dbba-94d2-446f-8581-c60d40d1b6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.930706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0dbba-94d2-446f-8581-c60d40d1b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.930976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0dbba-94d2-446f-8581-c60d40d1b6e4 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.938049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0dbba-94d2-446f-8581-c60d40d1b6e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:54.940084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0dbba-94d2-446f-8581-c60d40d1b6e4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:54.940203 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299fbdc-f742-447d-9c87-e539520f1885 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:54.941839 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 196/394] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:54 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:54.952626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-d299fbdc-f742-447d-9c87-e539520f1885 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:54.954527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 199/395] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:12:54.956471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0dbba-94d2-446f-8581-c60d40d1b6e4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.959656 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299fbdc-f742-447d-9c87-e539520f1885 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:54.970373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299fbdc-f742-447d-9c87-e539520f1885 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.974497 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0dbba-94d2-446f-8581-c60d40d1b6e4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:54.976339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24496-1ff8-4744-bfc1-a0b13937b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.977347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24496-1ff8-4744-bfc1-a0b13937b5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.977838 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24496-1ff8-4744-bfc1-a0b13937b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.978351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24496-1ff8-4744-bfc1-a0b13937b5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.979302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd24496-1ff8-4744-bfc1-a0b13937b5e8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:54.979840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd24496-1ff8-4744-bfc1-a0b13937b5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:54.982000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd24496-1ff8-4744-bfc1-a0b13937b5e8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:54.990789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500cfc4-c6c8-4e43-961c-2a3751573a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:54.991651 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500cfc4-c6c8-4e43-961c-2a3751573a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:54.991922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500cfc4-c6c8-4e43-961c-2a3751573a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:54.992185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500cfc4-c6c8-4e43-961c-2a3751573a63 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/groups/a8335b25dd8e40bb8c6464cb9e461085/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:54.994813 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 200/396] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:54.998882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500cfc4-c6c8-4e43-961c-2a3751573a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f075290bd58d4cc388aa95e6b59b2fab, group_id=a8335b25dd8e40bb8c6464cb9e461085, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:55.001705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24496-1ff8-4744-bfc1-a0b13937b5e8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:55.006665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500cfc4-c6c8-4e43-961c-2a3751573a63 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:55.024580 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 197/397] 10.222.0.16 () {58 vars in 1463 bytes} [Fri Jan 28 01:12:54 2022] PUT /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/groups/a8335b25dd8e40bb8c6464cb9e461085/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:55.031716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24496-1ff8-4744-bfc1-a0b13937b5e8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:55.119838 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5eb144-426c-4505-9144-3e3462e84e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:55.120721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eb144-426c-4505-9144-3e3462e84e30 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:55.120992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eb144-426c-4505-9144-3e3462e84e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:55.121347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eb144-426c-4505-9144-3e3462e84e30 admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:55.126137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5eb144-426c-4505-9144-3e3462e84e30 admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:55.128093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5eb144-426c-4505-9144-3e3462e84e30 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:55.130007 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 201/398] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:55 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:55.138562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500cfc4-c6c8-4e43-961c-2a3751573a63 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:55.156222 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500cfc4-c6c8-4e43-961c-2a3751573a63 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:55.161550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b1fbd-2b09-4d48-9207-8ea35a4edcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:55.162689 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1fbd-2b09-4d48-9207-8ea35a4edcbe admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:55.163187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1fbd-2b09-4d48-9207-8ea35a4edcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:55.163699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1fbd-2b09-4d48-9207-8ea35a4edcbe admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:55.165181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b1fbd-2b09-4d48-9207-8ea35a4edcbe admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:55.167512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b1fbd-2b09-4d48-9207-8ea35a4edcbe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:55.174058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 198/399] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:55 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:55.180087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5eb144-426c-4505-9144-3e3462e84e30 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:55.195122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5eb144-426c-4505-9144-3e3462e84e30 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:55.205543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60867980-820c-40c6-8176-924a35b2cc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:55.206493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867980-820c-40c6-8176-924a35b2cc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:55.206768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867980-820c-40c6-8176-924a35b2cc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:55.207033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867980-820c-40c6-8176-924a35b2cc65 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/groups/a8335b25dd8e40bb8c6464cb9e461085/roles/7cc6510c2843471b8db1852425803574` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:55.215604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60867980-820c-40c6-8176-924a35b2cc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d55db5bd2549ce81113a761b93b5f7, group_id=a8335b25dd8e40bb8c6464cb9e461085, role_id=7cc6510c2843471b8db1852425803574)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:55.218324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60867980-820c-40c6-8176-924a35b2cc65 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:55.235553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 202/400] 10.222.0.16 () {58 vars in 1463 bytes} [Fri Jan 28 01:12:55 2022] PUT /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7/groups/a8335b25dd8e40bb8c6464cb9e461085/roles/7cc6510c2843471b8db1852425803574 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:55.717391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebf0a3-d9af-4a7f-a270-03b0078cd5f8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:55.717914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebf0a3-d9af-4a7f-a270-03b0078cd5f8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:55.717914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebf0a3-d9af-4a7f-a270-03b0078cd5f8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:55.719983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 199/401] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:55.725939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a181aa-6410-43fc-bdc0-341a1ba30c97 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:55.726359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a181aa-6410-43fc-bdc0-341a1ba30c97 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:55.726549 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a181aa-6410-43fc-bdc0-341a1ba30c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:55.750238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e1a181aa-6410-43fc-bdc0-341a1ba30c97 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:55.751440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e1a181aa-6410-43fc-bdc0-341a1ba30c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:55.829700 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 203/402] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:55.865763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebf0a3-d9af-4a7f-a270-03b0078cd5f8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:55.883744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebf0a3-d9af-4a7f-a270-03b0078cd5f8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:55.888681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb478e-5a40-456f-937d-27f8ddc597c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:55.889787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb478e-5a40-456f-937d-27f8ddc597c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:55.890270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb478e-5a40-456f-937d-27f8ddc597c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:55.890733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb478e-5a40-456f-937d-27f8ddc597c4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:55.906375 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb478e-5a40-456f-937d-27f8ddc597c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:55.913507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-20cb478e-5a40-456f-937d-27f8ddc597c4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:55.914902 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 200/403] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:55.920977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a181aa-6410-43fc-bdc0-341a1ba30c97 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:55.935661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a181aa-6410-43fc-bdc0-341a1ba30c97 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:55.940148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e39352-de06-43e3-a3ae-93b2b3f8c19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:55.940810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e39352-de06-43e3-a3ae-93b2b3f8c19a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:55.941088 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e39352-de06-43e3-a3ae-93b2b3f8c19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:55.941379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e39352-de06-43e3-a3ae-93b2b3f8c19a admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:55.942143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e39352-de06-43e3-a3ae-93b2b3f8c19a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:55.942444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e39352-de06-43e3-a3ae-93b2b3f8c19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:55.944060 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e39352-de06-43e3-a3ae-93b2b3f8c19a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:55.957498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 204/404] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:55.963124 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb478e-5a40-456f-937d-27f8ddc597c4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:55.978742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb478e-5a40-456f-937d-27f8ddc597c4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:55.985837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f985ba-fd93-48cb-b171-615856af8007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:55.986677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f985ba-fd93-48cb-b171-615856af8007 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:55.986952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f985ba-fd93-48cb-b171-615856af8007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:55.987243 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f985ba-fd93-48cb-b171-615856af8007 admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:55.988426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f985ba-fd93-48cb-b171-615856af8007 admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:55.989463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-09f985ba-fd93-48cb-b171-615856af8007 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:12:55.989463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:12:55.989463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:12:55.990627 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f985ba-fd93-48cb-b171-615856af8007 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:55.992526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 201/405] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:55 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:55.999568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e39352-de06-43e3-a3ae-93b2b3f8c19a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:56.014282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e39352-de06-43e3-a3ae-93b2b3f8c19a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:56.019832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab3741-7511-48ea-b875-fcdd13871c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:56.021005 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab3741-7511-48ea-b875-fcdd13871c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:56.021580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab3741-7511-48ea-b875-fcdd13871c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:56.022085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab3741-7511-48ea-b875-fcdd13871c85 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:56.023553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab3741-7511-48ea-b875-fcdd13871c85 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:56.025922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab3741-7511-48ea-b875-fcdd13871c85 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:56.028333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 205/406] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:55 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:56.034225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f985ba-fd93-48cb-b171-615856af8007 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:56.047428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f985ba-fd93-48cb-b171-615856af8007 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:56.055638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac06c2-82d8-4db8-8ff6-d8dd4991c800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:56.056521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac06c2-82d8-4db8-8ff6-d8dd4991c800 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:56.056797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac06c2-82d8-4db8-8ff6-d8dd4991c800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:56.057063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac06c2-82d8-4db8-8ff6-d8dd4991c800 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/groups/a8335b25dd8e40bb8c6464cb9e461085/roles/7cc6510c2843471b8db1852425803574` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:56.063054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac06c2-82d8-4db8-8ff6-d8dd4991c800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f075290bd58d4cc388aa95e6b59b2fab, group_id=a8335b25dd8e40bb8c6464cb9e461085, role_id=7cc6510c2843471b8db1852425803574)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:56.065740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac06c2-82d8-4db8-8ff6-d8dd4991c800 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:56.085740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 202/407] 10.222.0.16 () {58 vars in 1463 bytes} [Fri Jan 28 01:12:56 2022] PUT /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab/groups/a8335b25dd8e40bb8c6464cb9e461085/roles/7cc6510c2843471b8db1852425803574 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:56.922797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2334d-039d-46a6-a5c0-eead00784c3d None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:56.923851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2334d-039d-46a6-a5c0-eead00784c3d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:56.924353 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2334d-039d-46a6-a5c0-eead00784c3d None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:56.926396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 206/408] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:56.931837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca883c2-b32a-439b-868d-77fcb2853ef7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:56.932684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca883c2-b32a-439b-868d-77fcb2853ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:56.933154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca883c2-b32a-439b-868d-77fcb2853ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:56.957576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-bca883c2-b32a-439b-868d-77fcb2853ef7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:56.959118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bca883c2-b32a-439b-868d-77fcb2853ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:57.026627 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 203/409] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:57.063310 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d934cc4-0c92-47be-b3c6-c26e8847332d None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.063638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d934cc4-0c92-47be-b3c6-c26e8847332d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.064126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d934cc4-0c92-47be-b3c6-c26e8847332d None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.065162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca883c2-b32a-439b-868d-77fcb2853ef7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.066228 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 207/410] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:57.071951 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a4130-b0c8-4ea2-a444-b0d9b22b8c80 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.072260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a4130-b0c8-4ea2-a444-b0d9b22b8c80 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.072485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a4130-b0c8-4ea2-a444-b0d9b22b8c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.078058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca883c2-b32a-439b-868d-77fcb2853ef7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.089166 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441627f-9d9f-487d-86b2-5becb0e0e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.090556 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441627f-9d9f-487d-86b2-5becb0e0e9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.091195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441627f-9d9f-487d-86b2-5becb0e0e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.091681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441627f-9d9f-487d-86b2-5becb0e0e9a0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.094681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-800a4130-b0c8-4ea2-a444-b0d9b22b8c80 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:57.095857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-800a4130-b0c8-4ea2-a444-b0d9b22b8c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:57.104216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 208/411] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:57.110143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441627f-9d9f-487d-86b2-5becb0e0e9a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:57.117239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-7441627f-9d9f-487d-86b2-5becb0e0e9a0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:57.118731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 204/412] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:12:57.124597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a4130-b0c8-4ea2-a444-b0d9b22b8c80 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.133704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441627f-9d9f-487d-86b2-5becb0e0e9a0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.137812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a4130-b0c8-4ea2-a444-b0d9b22b8c80 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.147309 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441627f-9d9f-487d-86b2-5becb0e0e9a0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.150819 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf0f6-d5dc-4c3c-b8a0-5aa517e2500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.151488 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf0f6-d5dc-4c3c-b8a0-5aa517e2500e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.151760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf0f6-d5dc-4c3c-b8a0-5aa517e2500e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.152021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf0f6-d5dc-4c3c-b8a0-5aa517e2500e admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.152827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76baf0f6-d5dc-4c3c-b8a0-5aa517e2500e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:57.153124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76baf0f6-d5dc-4c3c-b8a0-5aa517e2500e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:57.154754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76baf0f6-d5dc-4c3c-b8a0-5aa517e2500e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:57.163743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34124f03-542c-4428-aa89-8977d878e386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.164538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34124f03-542c-4428-aa89-8977d878e386 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.164809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34124f03-542c-4428-aa89-8977d878e386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.165074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34124f03-542c-4428-aa89-8977d878e386 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.171057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 209/413] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:57.176682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf0f6-d5dc-4c3c-b8a0-5aa517e2500e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.179844 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34124f03-542c-4428-aa89-8977d878e386 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:57.188016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-34124f03-542c-4428-aa89-8977d878e386 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:57.189504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf0f6-d5dc-4c3c-b8a0-5aa517e2500e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.189613 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 205/414] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:12:57.196452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34124f03-542c-4428-aa89-8977d878e386 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.200652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d701e-5ae8-42ea-82ee-36e81cb5b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.201847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d701e-5ae8-42ea-82ee-36e81cb5b17f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.202300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d701e-5ae8-42ea-82ee-36e81cb5b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.202738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d701e-5ae8-42ea-82ee-36e81cb5b17f admin admin] PATH_INFO: `/v3/groups/6ebc7082aef54895be6b2316db794d34` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.204168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d701e-5ae8-42ea-82ee-36e81cb5b17f admin admin] RBAC: Authorizing `identity:get_group(group_id=6ebc7082aef54895be6b2316db794d34)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:57.206300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d701e-5ae8-42ea-82ee-36e81cb5b17f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:57.213521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34124f03-542c-4428-aa89-8977d878e386 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.213664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 210/415] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:57 2022] GET /identity/v3/groups/6ebc7082aef54895be6b2316db794d34 => generated 229 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:57.219414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d701e-5ae8-42ea-82ee-36e81cb5b17f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.220036 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12c80f-c7f2-4af5-b56a-d2b20479fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.224022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12c80f-c7f2-4af5-b56a-d2b20479fd9a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.224281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12c80f-c7f2-4af5-b56a-d2b20479fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.224596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12c80f-c7f2-4af5-b56a-d2b20479fd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.225397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12c80f-c7f2-4af5-b56a-d2b20479fd9a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:57.225698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12c80f-c7f2-4af5-b56a-d2b20479fd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:57.232354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12c80f-c7f2-4af5-b56a-d2b20479fd9a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:57.236217 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d701e-5ae8-42ea-82ee-36e81cb5b17f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.247307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 206/416] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:57.252248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d914c31-ff9e-4c63-b5db-c383854dd6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.253220 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d914c31-ff9e-4c63-b5db-c383854dd6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.254279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12c80f-c7f2-4af5-b56a-d2b20479fd9a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.254875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d914c31-ff9e-4c63-b5db-c383854dd6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.255194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d914c31-ff9e-4c63-b5db-c383854dd6ca admin admin] PATH_INFO: `/v3/projects/890dca85d3164528880613bf0afcbf95` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.256748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d914c31-ff9e-4c63-b5db-c383854dd6ca admin admin] RBAC: Authorizing `identity:get_project(project_id=890dca85d3164528880613bf0afcbf95)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:57.260801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d914c31-ff9e-4c63-b5db-c383854dd6ca admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:57.263709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 211/417] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:57 2022] GET /identity/v3/projects/890dca85d3164528880613bf0afcbf95 => generated 344 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:57.269945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d914c31-ff9e-4c63-b5db-c383854dd6ca admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.274940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12c80f-c7f2-4af5-b56a-d2b20479fd9a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.280551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d914c31-ff9e-4c63-b5db-c383854dd6ca admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.287457 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f20562-b4e2-4be5-b173-64633a5f7907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.288600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22114af8-9c4f-4b00-bb91-cb68e4e563d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.289305 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22114af8-9c4f-4b00-bb91-cb68e4e563d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.289732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20562-b4e2-4be5-b173-64633a5f7907 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.290050 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22114af8-9c4f-4b00-bb91-cb68e4e563d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.290315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22114af8-9c4f-4b00-bb91-cb68e4e563d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.290550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20562-b4e2-4be5-b173-64633a5f7907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.290826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20562-b4e2-4be5-b173-64633a5f7907 admin admin] PATH_INFO: `/v3/projects/890dca85d3164528880613bf0afcbf95/groups/6ebc7082aef54895be6b2316db794d34/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.295383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f20562-b4e2-4be5-b173-64633a5f7907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890dca85d3164528880613bf0afcbf95, group_id=6ebc7082aef54895be6b2316db794d34, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:57.300091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f20562-b4e2-4be5-b173-64633a5f7907 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:57.308094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22114af8-9c4f-4b00-bb91-cb68e4e563d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:57.310078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22114af8-9c4f-4b00-bb91-cb68e4e563d9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:57.324384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 212/418] 10.222.0.16 () {58 vars in 1463 bytes} [Fri Jan 28 01:12:57 2022] PUT /identity/v3/projects/890dca85d3164528880613bf0afcbf95/groups/6ebc7082aef54895be6b2316db794d34/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:12:57.327175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 207/419] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:57.332936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f20562-b4e2-4be5-b173-64633a5f7907 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.397769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f20562-b4e2-4be5-b173-64633a5f7907 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.402517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff323a-967e-4765-b734-a62b1f629567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.403473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff323a-967e-4765-b734-a62b1f629567 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.403792 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff323a-967e-4765-b734-a62b1f629567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.404061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff323a-967e-4765-b734-a62b1f629567 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.405412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff323a-967e-4765-b734-a62b1f629567 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:57.407642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff323a-967e-4765-b734-a62b1f629567 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:57.409447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 213/420] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:57 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:57.415240 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22114af8-9c4f-4b00-bb91-cb68e4e563d9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.425812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22114af8-9c4f-4b00-bb91-cb68e4e563d9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.430835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc847-d32b-44f6-8731-a052fc754684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.431723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc847-d32b-44f6-8731-a052fc754684 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.431997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc847-d32b-44f6-8731-a052fc754684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.432265 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc847-d32b-44f6-8731-a052fc754684 admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.433612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc847-d32b-44f6-8731-a052fc754684 admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:57.435900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc847-d32b-44f6-8731-a052fc754684 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:57.438074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 208/421] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:57 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:57.443886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff323a-967e-4765-b734-a62b1f629567 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:57.454111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff323a-967e-4765-b734-a62b1f629567 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:57.458843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c1619-5159-48d6-a25c-f3a618deb0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:57.459508 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1619-5159-48d6-a25c-f3a618deb0df admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.459780 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1619-5159-48d6-a25c-f3a618deb0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.460047 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1619-5159-48d6-a25c-f3a618deb0df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.460919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c1619-5159-48d6-a25c-f3a618deb0df admin admin] RBAC: Adding query filter params (group.id=a8335b25dd8e40bb8c6464cb9e461085, role.id=726ccf812eba475187c3df7288e1d46b, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:57.461304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c1619-5159-48d6-a25c-f3a618deb0df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:57.463163 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c1619-5159-48d6-a25c-f3a618deb0df admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:57.470100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 214/422] 10.222.0.16 () {56 vars in 1397 bytes} [Fri Jan 28 01:12:57 2022] GET /identity/v3/role_assignments?group.id=a8335b25dd8e40bb8c6464cb9e461085&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=726ccf812eba475187c3df7288e1d46b => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:57.986695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157f54-0ee5-40b2-8c65-c668b51ecfec None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.987397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157f54-0ee5-40b2-8c65-c668b51ecfec None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.987397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157f54-0ee5-40b2-8c65-c668b51ecfec None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:57.989276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 209/423] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:57.995108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa14bc1-e781-4d3e-8c5d-139139da8e83 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:57.995647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa14bc1-e781-4d3e-8c5d-139139da8e83 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:57.995647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa14bc1-e781-4d3e-8c5d-139139da8e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.017512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-daa14bc1-e781-4d3e-8c5d-139139da8e83 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:58.018703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-daa14bc1-e781-4d3e-8c5d-139139da8e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:58.029634 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 215/424] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:58.055837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157f54-0ee5-40b2-8c65-c668b51ecfec None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.069631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157f54-0ee5-40b2-8c65-c668b51ecfec None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.074261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f76e7-efb5-4cc9-92bc-99655b7c7bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.075500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f76e7-efb5-4cc9-92bc-99655b7c7bea admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.076608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f76e7-efb5-4cc9-92bc-99655b7c7bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.077094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f76e7-efb5-4cc9-92bc-99655b7c7bea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.088401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f76e7-efb5-4cc9-92bc-99655b7c7bea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:58.095978 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-107f76e7-efb5-4cc9-92bc-99655b7c7bea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 28 01:12:58.097731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 210/425] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:58.104037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa14bc1-e781-4d3e-8c5d-139139da8e83 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.118177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa14bc1-e781-4d3e-8c5d-139139da8e83 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.123445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601b453-cb73-42bc-9d8b-e18cc1d8ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.124076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601b453-cb73-42bc-9d8b-e18cc1d8ee9a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.124350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601b453-cb73-42bc-9d8b-e18cc1d8ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.124615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601b453-cb73-42bc-9d8b-e18cc1d8ee9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.125400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601b453-cb73-42bc-9d8b-e18cc1d8ee9a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:58.125698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601b453-cb73-42bc-9d8b-e18cc1d8ee9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:58.127300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601b453-cb73-42bc-9d8b-e18cc1d8ee9a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:58.137651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 216/426] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:58.143594 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f76e7-efb5-4cc9-92bc-99655b7c7bea admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.153899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f76e7-efb5-4cc9-92bc-99655b7c7bea admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.158577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d013f7e-8674-4559-969f-9ed157f23987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.159463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013f7e-8674-4559-969f-9ed157f23987 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.159941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013f7e-8674-4559-969f-9ed157f23987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.160408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013f7e-8674-4559-969f-9ed157f23987 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.168916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d013f7e-8674-4559-969f-9ed157f23987 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:58.170990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d013f7e-8674-4559-969f-9ed157f23987 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:58.181032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 211/427] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:58.187031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601b453-cb73-42bc-9d8b-e18cc1d8ee9a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.197398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601b453-cb73-42bc-9d8b-e18cc1d8ee9a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.202367 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9df7-fad1-4127-8e6f-aacc79b5ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.203476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9df7-fad1-4127-8e6f-aacc79b5ba24 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.204002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9df7-fad1-4127-8e6f-aacc79b5ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.204466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf9df7-fad1-4127-8e6f-aacc79b5ba24 admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.205904 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf9df7-fad1-4127-8e6f-aacc79b5ba24 admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:58.208166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf9df7-fad1-4127-8e6f-aacc79b5ba24 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:58.210362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 217/428] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:58.216095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d013f7e-8674-4559-969f-9ed157f23987 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.225948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d013f7e-8674-4559-969f-9ed157f23987 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.230612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c25c4f-436c-46b3-b64d-8cf581febe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.231905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c25c4f-436c-46b3-b64d-8cf581febe46 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.232386 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c25c4f-436c-46b3-b64d-8cf581febe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.232871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c25c4f-436c-46b3-b64d-8cf581febe46 admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.234332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c25c4f-436c-46b3-b64d-8cf581febe46 admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:58.236506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c25c4f-436c-46b3-b64d-8cf581febe46 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:58.238418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 212/429] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:58.244569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9df7-fad1-4127-8e6f-aacc79b5ba24 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.254927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf9df7-fad1-4127-8e6f-aacc79b5ba24 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.259597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71714004-8a5e-4948-a160-efd40332c977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.260477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714004-8a5e-4948-a160-efd40332c977 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.260953 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714004-8a5e-4948-a160-efd40332c977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.261473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71714004-8a5e-4948-a160-efd40332c977 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.262603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71714004-8a5e-4948-a160-efd40332c977 admin admin] RBAC: Adding query filter params (group.id=a8335b25dd8e40bb8c6464cb9e461085, role.id=726ccf812eba475187c3df7288e1d46b, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:58.263214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71714004-8a5e-4948-a160-efd40332c977 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:58.265308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71714004-8a5e-4948-a160-efd40332c977 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:58.272340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 218/430] 10.222.0.16 () {56 vars in 1397 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/role_assignments?group.id=a8335b25dd8e40bb8c6464cb9e461085&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=726ccf812eba475187c3df7288e1d46b => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:58.294599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772078e-0a99-45a1-82cb-6f2994895cda None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.295262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772078e-0a99-45a1-82cb-6f2994895cda None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.295733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772078e-0a99-45a1-82cb-6f2994895cda None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.298221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 213/431] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:58.303652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ee8bf-71fe-413b-b38f-b5c02193ac46 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.303932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ee8bf-71fe-413b-b38f-b5c02193ac46 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.304201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ee8bf-71fe-413b-b38f-b5c02193ac46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.327497 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-188ee8bf-71fe-413b-b38f-b5c02193ac46 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:58.328698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-188ee8bf-71fe-413b-b38f-b5c02193ac46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:58.336656 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 219/432] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:12:58.362071 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772078e-0a99-45a1-82cb-6f2994895cda None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.382409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772078e-0a99-45a1-82cb-6f2994895cda None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.388170 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855975a5-e58c-48e9-b1b6-8dfe7ba15a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.389542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855975a5-e58c-48e9-b1b6-8dfe7ba15a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.390043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855975a5-e58c-48e9-b1b6-8dfe7ba15a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.390521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855975a5-e58c-48e9-b1b6-8dfe7ba15a7b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.407357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855975a5-e58c-48e9-b1b6-8dfe7ba15a7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:58.415211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-855975a5-e58c-48e9-b1b6-8dfe7ba15a7b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:58.417157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 214/433] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:58.422974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ee8bf-71fe-413b-b38f-b5c02193ac46 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.438352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ee8bf-71fe-413b-b38f-b5c02193ac46 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.443798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2612886-5643-4c10-8166-f280d4800aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.444497 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612886-5643-4c10-8166-f280d4800aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.444773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612886-5643-4c10-8166-f280d4800aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.445038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612886-5643-4c10-8166-f280d4800aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.445856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2612886-5643-4c10-8166-f280d4800aa7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:58.446165 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2612886-5643-4c10-8166-f280d4800aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:58.451591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2612886-5643-4c10-8166-f280d4800aa7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:58.461051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 220/434] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:58.466978 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855975a5-e58c-48e9-b1b6-8dfe7ba15a7b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.479404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855975a5-e58c-48e9-b1b6-8dfe7ba15a7b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.489449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe05a63-15d7-44f7-b3e6-ba06421ddbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.490800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05a63-15d7-44f7-b3e6-ba06421ddbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.491328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05a63-15d7-44f7-b3e6-ba06421ddbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.491784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe05a63-15d7-44f7-b3e6-ba06421ddbd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.501099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe05a63-15d7-44f7-b3e6-ba06421ddbd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:58.502892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe05a63-15d7-44f7-b3e6-ba06421ddbd8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:58.512461 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 215/435] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:58.517754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2612886-5643-4c10-8166-f280d4800aa7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.529829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2612886-5643-4c10-8166-f280d4800aa7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.537754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7cc3-ed90-4021-bd30-7aff0d497255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.538631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7cc3-ed90-4021-bd30-7aff0d497255 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.538909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7cc3-ed90-4021-bd30-7aff0d497255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.539175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a7cc3-ed90-4021-bd30-7aff0d497255 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.540416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a7cc3-ed90-4021-bd30-7aff0d497255 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:58.542523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a7cc3-ed90-4021-bd30-7aff0d497255 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:58.544686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 221/436] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:58.549922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe05a63-15d7-44f7-b3e6-ba06421ddbd8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.559180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe05a63-15d7-44f7-b3e6-ba06421ddbd8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.565754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1277635-ea92-4bc1-9c47-446abf131047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.566667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1277635-ea92-4bc1-9c47-446abf131047 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.566941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1277635-ea92-4bc1-9c47-446abf131047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.567256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1277635-ea92-4bc1-9c47-446abf131047 admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.568534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1277635-ea92-4bc1-9c47-446abf131047 admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:58.570546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1277635-ea92-4bc1-9c47-446abf131047 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:58.572512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 216/437] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:58.578491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7cc3-ed90-4021-bd30-7aff0d497255 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:58.589778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a7cc3-ed90-4021-bd30-7aff0d497255 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:58.597198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54c390-0ec4-4b4b-8480-29cf9f945695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:58.597877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54c390-0ec4-4b4b-8480-29cf9f945695 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:58.598517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54c390-0ec4-4b4b-8480-29cf9f945695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:58.598784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54c390-0ec4-4b4b-8480-29cf9f945695 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:58.599630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54c390-0ec4-4b4b-8480-29cf9f945695 admin admin] RBAC: Adding query filter params (group.id=a8335b25dd8e40bb8c6464cb9e461085, role.id=7cc6510c2843471b8db1852425803574, scope.project.id=b5d55db5bd2549ce81113a761b93b5f7) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:58.599934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54c390-0ec4-4b4b-8480-29cf9f945695 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:58.601840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54c390-0ec4-4b4b-8480-29cf9f945695 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:58.622220 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 222/438] 10.222.0.16 () {56 vars in 1397 bytes} [Fri Jan 28 01:12:58 2022] GET /identity/v3/role_assignments?group.id=a8335b25dd8e40bb8c6464cb9e461085&scope.project.id=b5d55db5bd2549ce81113a761b93b5f7&role.id=7cc6510c2843471b8db1852425803574 => generated 611 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:59.070530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2a03-ff5d-473c-95c6-ed062eb73b13 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.071047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2a03-ff5d-473c-95c6-ed062eb73b13 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.071047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2a03-ff5d-473c-95c6-ed062eb73b13 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.072881 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 217/439] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:59.078478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fd00b-7f6e-4db4-84c2-e421f6dcf852 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.078911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fd00b-7f6e-4db4-84c2-e421f6dcf852 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.079069 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fd00b-7f6e-4db4-84c2-e421f6dcf852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.097182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ff3fd00b-7f6e-4db4-84c2-e421f6dcf852 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:59.099467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ff3fd00b-7f6e-4db4-84c2-e421f6dcf852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:59.107152 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 223/440] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:59.130919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc2a03-ff5d-473c-95c6-ed062eb73b13 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:59.143218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc2a03-ff5d-473c-95c6-ed062eb73b13 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:59.147535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064155-4f82-45bc-9f47-c57377aad502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:59.148361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064155-4f82-45bc-9f47-c57377aad502 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.148608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064155-4f82-45bc-9f47-c57377aad502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.148880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e064155-4f82-45bc-9f47-c57377aad502 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.159508 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e064155-4f82-45bc-9f47-c57377aad502 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:59.166693 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-2e064155-4f82-45bc-9f47-c57377aad502 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:12:59.168098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 218/441] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:12:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:59.173705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fd00b-7f6e-4db4-84c2-e421f6dcf852 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:59.182928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fd00b-7f6e-4db4-84c2-e421f6dcf852 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:59.187669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb35fb-c7c0-4442-b114-8d2e35e6b1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:59.188338 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb35fb-c7c0-4442-b114-8d2e35e6b1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.188622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb35fb-c7c0-4442-b114-8d2e35e6b1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.188903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb35fb-c7c0-4442-b114-8d2e35e6b1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.189711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb35fb-c7c0-4442-b114-8d2e35e6b1d5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:59.190020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb35fb-c7c0-4442-b114-8d2e35e6b1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:59.191631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb35fb-c7c0-4442-b114-8d2e35e6b1d5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:59.201139 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 224/442] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:12:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:59.206688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064155-4f82-45bc-9f47-c57377aad502 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:59.216697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e064155-4f82-45bc-9f47-c57377aad502 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:59.222538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03e07-39af-40ac-9dde-8c5b956b355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:59.223560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03e07-39af-40ac-9dde-8c5b956b355f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.223837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03e07-39af-40ac-9dde-8c5b956b355f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.224106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03e07-39af-40ac-9dde-8c5b956b355f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.233558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03e07-39af-40ac-9dde-8c5b956b355f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:59.235323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03e07-39af-40ac-9dde-8c5b956b355f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:59.245418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 219/443] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:12:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:12:59.251379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb35fb-c7c0-4442-b114-8d2e35e6b1d5 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:59.260951 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb35fb-c7c0-4442-b114-8d2e35e6b1d5 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:59.265322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18124d-f2ba-4d53-b1e3-9688c97c771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:59.266178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18124d-f2ba-4d53-b1e3-9688c97c771f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.266453 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18124d-f2ba-4d53-b1e3-9688c97c771f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.266719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18124d-f2ba-4d53-b1e3-9688c97c771f admin admin] PATH_INFO: `/v3/projects/f075290bd58d4cc388aa95e6b59b2fab` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.267990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18124d-f2ba-4d53-b1e3-9688c97c771f admin admin] RBAC: Authorizing `identity:get_project(project_id=f075290bd58d4cc388aa95e6b59b2fab)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:59.270100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18124d-f2ba-4d53-b1e3-9688c97c771f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:59.271766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 225/444] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:12:59 2022] GET /identity/v3/projects/f075290bd58d4cc388aa95e6b59b2fab => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:59.277347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03e07-39af-40ac-9dde-8c5b956b355f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:59.287342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03e07-39af-40ac-9dde-8c5b956b355f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:59.291694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2ebf8-1115-42f1-a153-2b04c4ad26ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:59.292532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2ebf8-1115-42f1-a153-2b04c4ad26ce admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.292806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2ebf8-1115-42f1-a153-2b04c4ad26ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.293068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2ebf8-1115-42f1-a153-2b04c4ad26ce admin admin] PATH_INFO: `/v3/groups/a8335b25dd8e40bb8c6464cb9e461085` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.294359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2ebf8-1115-42f1-a153-2b04c4ad26ce admin admin] RBAC: Authorizing `identity:get_group(group_id=a8335b25dd8e40bb8c6464cb9e461085)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:59.296296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2ebf8-1115-42f1-a153-2b04c4ad26ce admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:59.298259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 220/445] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:12:59 2022] GET /identity/v3/groups/a8335b25dd8e40bb8c6464cb9e461085 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:12:59.303804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18124d-f2ba-4d53-b1e3-9688c97c771f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:59.313967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18124d-f2ba-4d53-b1e3-9688c97c771f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:59.318940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f60a2e5-1b4b-4fc5-9370-2e3212e5fe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:59.319684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60a2e5-1b4b-4fc5-9370-2e3212e5fe6e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.320063 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60a2e5-1b4b-4fc5-9370-2e3212e5fe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.320331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60a2e5-1b4b-4fc5-9370-2e3212e5fe6e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.321463 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60a2e5-1b4b-4fc5-9370-2e3212e5fe6e admin admin] RBAC: Adding query filter params (group.id=a8335b25dd8e40bb8c6464cb9e461085, role.id=7cc6510c2843471b8db1852425803574, scope.project.id=f075290bd58d4cc388aa95e6b59b2fab) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:59.321711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60a2e5-1b4b-4fc5-9370-2e3212e5fe6e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:12:59.323577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f60a2e5-1b4b-4fc5-9370-2e3212e5fe6e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:12:59.329990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 226/446] 10.222.0.16 () {56 vars in 1397 bytes} [Fri Jan 28 01:12:59 2022] GET /identity/v3/role_assignments?group.id=a8335b25dd8e40bb8c6464cb9e461085&scope.project.id=f075290bd58d4cc388aa95e6b59b2fab&role.id=7cc6510c2843471b8db1852425803574 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:12:59.867155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5568f6d-e205-4363-9369-1de645c53c8b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.867592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5568f6d-e205-4363-9369-1de645c53c8b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.868019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5568f6d-e205-4363-9369-1de645c53c8b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.870961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 221/447] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:12:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:12:59.876848 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595b81-b6b5-4869-81da-f90ddd2fecc5 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.877127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595b81-b6b5-4869-81da-f90ddd2fecc5 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.877416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595b81-b6b5-4869-81da-f90ddd2fecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.896844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1d595b81-b6b5-4869-81da-f90ddd2fecc5 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:12:59.897938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1d595b81-b6b5-4869-81da-f90ddd2fecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:12:59.906536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 227/448] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:12:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:12:59.930325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5568f6d-e205-4363-9369-1de645c53c8b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:59.945529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5568f6d-e205-4363-9369-1de645c53c8b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:59.951471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13fa6f-63cd-4784-9d62-ae4bd19c278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:59.952244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13fa6f-63cd-4784-9d62-ae4bd19c278f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.952526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13fa6f-63cd-4784-9d62-ae4bd19c278f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.952796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13fa6f-63cd-4784-9d62-ae4bd19c278f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.964709 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13fa6f-63cd-4784-9d62-ae4bd19c278f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:12:59.971534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-5d13fa6f-63cd-4784-9d62-ae4bd19c278f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:12:59.972666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 222/449] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:12:59.978985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595b81-b6b5-4869-81da-f90ddd2fecc5 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:12:59.991378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595b81-b6b5-4869-81da-f90ddd2fecc5 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:12:59.997544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c28795-2db1-46bc-8f74-2c0edabc9b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:12:59.998215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c28795-2db1-46bc-8f74-2c0edabc9b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:12:59.998482 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c28795-2db1-46bc-8f74-2c0edabc9b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:12:59.998728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c28795-2db1-46bc-8f74-2c0edabc9b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:12:59.999485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c28795-2db1-46bc-8f74-2c0edabc9b72 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:12:59.999791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c28795-2db1-46bc-8f74-2c0edabc9b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:00.001447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c28795-2db1-46bc-8f74-2c0edabc9b72 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:00.010040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 228/450] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:00.015489 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13fa6f-63cd-4784-9d62-ae4bd19c278f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:00.025451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13fa6f-63cd-4784-9d62-ae4bd19c278f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:00.031154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214e10d-43dd-449b-8761-ddf5360eaa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:00.031768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214e10d-43dd-449b-8761-ddf5360eaa4f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:00.032041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214e10d-43dd-449b-8761-ddf5360eaa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:00.032305 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214e10d-43dd-449b-8761-ddf5360eaa4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:00.040957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214e10d-43dd-449b-8761-ddf5360eaa4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:00.042734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214e10d-43dd-449b-8761-ddf5360eaa4f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:00.052318 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 223/451] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:00.060793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c28795-2db1-46bc-8f74-2c0edabc9b72 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:00.076142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c28795-2db1-46bc-8f74-2c0edabc9b72 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:00.081822 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd48391-eba3-429a-b997-88eac6adc3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:00.082647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd48391-eba3-429a-b997-88eac6adc3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:00.082924 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd48391-eba3-429a-b997-88eac6adc3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:00.083191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd48391-eba3-429a-b997-88eac6adc3e2 admin admin] PATH_INFO: `/v3/projects/890dca85d3164528880613bf0afcbf95` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:00.084515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd48391-eba3-429a-b997-88eac6adc3e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=890dca85d3164528880613bf0afcbf95)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:00.086332 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd48391-eba3-429a-b997-88eac6adc3e2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:00.087944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 229/452] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:13:00 2022] GET /identity/v3/projects/890dca85d3164528880613bf0afcbf95 => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:00.093153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214e10d-43dd-449b-8761-ddf5360eaa4f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:00.102418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214e10d-43dd-449b-8761-ddf5360eaa4f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:00.108054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a938b5-e559-4a01-a357-9e7792cbc5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:00.108860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a938b5-e559-4a01-a357-9e7792cbc5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:00.109131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a938b5-e559-4a01-a357-9e7792cbc5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:00.109436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a938b5-e559-4a01-a357-9e7792cbc5e6 admin admin] PATH_INFO: `/v3/groups/6ebc7082aef54895be6b2316db794d34` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:00.110742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a938b5-e559-4a01-a357-9e7792cbc5e6 admin admin] RBAC: Authorizing `identity:get_group(group_id=6ebc7082aef54895be6b2316db794d34)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:00.112622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a938b5-e559-4a01-a357-9e7792cbc5e6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:00.114198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 224/453] 10.222.0.16 () {56 vars in 1201 bytes} [Fri Jan 28 01:13:00 2022] GET /identity/v3/groups/6ebc7082aef54895be6b2316db794d34 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:00.119497 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd48391-eba3-429a-b997-88eac6adc3e2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:00.130166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd48391-eba3-429a-b997-88eac6adc3e2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:00.136117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84113522-83ae-419b-870f-eddfcfff35a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:00.136719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84113522-83ae-419b-870f-eddfcfff35a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:00.136996 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84113522-83ae-419b-870f-eddfcfff35a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:00.137387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84113522-83ae-419b-870f-eddfcfff35a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:00.138221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84113522-83ae-419b-870f-eddfcfff35a3 admin admin] RBAC: Adding query filter params (group.id=6ebc7082aef54895be6b2316db794d34, role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=890dca85d3164528880613bf0afcbf95) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:00.138525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84113522-83ae-419b-870f-eddfcfff35a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:00.140315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84113522-83ae-419b-870f-eddfcfff35a3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:00.146479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 230/454] 10.222.0.16 () {56 vars in 1397 bytes} [Fri Jan 28 01:13:00 2022] GET /identity/v3/role_assignments?group.id=6ebc7082aef54895be6b2316db794d34&scope.project.id=890dca85d3164528880613bf0afcbf95&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:02.774275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a5cb-3283-479e-9b7e-1d00a286382d None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:02.774821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a5cb-3283-479e-9b7e-1d00a286382d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:02.774821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511a5cb-3283-479e-9b7e-1d00a286382d None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:02.776909 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 225/455] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:02.783009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85f948-837e-4dda-9023-9194245cc640 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:02.783818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85f948-837e-4dda-9023-9194245cc640 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:02.784300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85f948-837e-4dda-9023-9194245cc640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:02.806154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4a85f948-837e-4dda-9023-9194245cc640 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:02.807660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4a85f948-837e-4dda-9023-9194245cc640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:02.816002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 231/456] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:02.858772 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511a5cb-3283-479e-9b7e-1d00a286382d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:02.874823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511a5cb-3283-479e-9b7e-1d00a286382d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:02.881068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596d1da-250e-4591-8b8b-2ea976b409de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:02.882286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596d1da-250e-4591-8b8b-2ea976b409de admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:02.882598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596d1da-250e-4591-8b8b-2ea976b409de admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:02.882969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596d1da-250e-4591-8b8b-2ea976b409de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:02.900342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596d1da-250e-4591-8b8b-2ea976b409de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:02.902518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596d1da-250e-4591-8b8b-2ea976b409de admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:02.928964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-b596d1da-250e-4591-8b8b-2ea976b409de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:02.930515 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 226/457] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:02.936477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85f948-837e-4dda-9023-9194245cc640 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:02.955726 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85f948-837e-4dda-9023-9194245cc640 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:02.970422 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d028b7-7550-4c03-b58a-551652dd8bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:02.971100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d028b7-7550-4c03-b58a-551652dd8bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:02.971373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d028b7-7550-4c03-b58a-551652dd8bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:02.971638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d028b7-7550-4c03-b58a-551652dd8bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:02.972384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d028b7-7550-4c03-b58a-551652dd8bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:02.972681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d028b7-7550-4c03-b58a-551652dd8bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:02.974707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d028b7-7550-4c03-b58a-551652dd8bb9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:02.985579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f3464-b654-4e51-bb3a-31094fc694c1 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:02.986154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f3464-b654-4e51-bb3a-31094fc694c1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:02.986639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f3464-b654-4e51-bb3a-31094fc694c1 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:02.988890 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 227/458] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:13:02.993818 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb29f-2ef1-48d1-b9b3-9e1764429eaa None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:02.994339 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb29f-2ef1-48d1-b9b3-9e1764429eaa None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:02.994801 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb29f-2ef1-48d1-b9b3-9e1764429eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:02.995997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 232/459] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:03.002216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d028b7-7550-4c03-b58a-551652dd8bb9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:03.012204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d028b7-7550-4c03-b58a-551652dd8bb9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:03.017004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d10a40-99bc-47d5-ac0c-c0beaeff1c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:03.017919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d10a40-99bc-47d5-ac0c-c0beaeff1c29 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.018440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d10a40-99bc-47d5-ac0c-c0beaeff1c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.018903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d10a40-99bc-47d5-ac0c-c0beaeff1c29 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.019825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d10a40-99bc-47d5-ac0c-c0beaeff1c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:03.021989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d10a40-99bc-47d5-ac0c-c0beaeff1c29 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:03.026223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b1bfb29f-2ef1-48d1-b9b3-9e1764429eaa None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:03.027405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b1bfb29f-2ef1-48d1-b9b3-9e1764429eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:03.039837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 228/460] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:03.054686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 233/461] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:13:03 2022] POST /identity/v3/users => generated 246 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:13:03.087561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0658f1f-a5d4-4f6c-bd21-d6383a8b2f13 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.088158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0658f1f-a5d4-4f6c-bd21-d6383a8b2f13 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.088636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0658f1f-a5d4-4f6c-bd21-d6383a8b2f13 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.090738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 229/462] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:03.096518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62e31c-ce5b-4e26-921f-3aee93ad8c89 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.097071 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62e31c-ce5b-4e26-921f-3aee93ad8c89 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.097570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62e31c-ce5b-4e26-921f-3aee93ad8c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.100558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0658f1f-a5d4-4f6c-bd21-d6383a8b2f13 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:03.125276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0658f1f-a5d4-4f6c-bd21-d6383a8b2f13 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:03.131990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098b987-6348-43a8-bdfa-b5c871c34c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:03.133090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b987-6348-43a8-bdfa-b5c871c34c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.133565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b987-6348-43a8-bdfa-b5c871c34c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.135419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098b987-6348-43a8-bdfa-b5c871c34c65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.141626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-be62e31c-ce5b-4e26-921f-3aee93ad8c89 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:03.144531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-be62e31c-ce5b-4e26-921f-3aee93ad8c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:03.152473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098b987-6348-43a8-bdfa-b5c871c34c65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:03.154892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098b987-6348-43a8-bdfa-b5c871c34c65 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:03.166958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 234/463] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:03.174791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a098b987-6348-43a8-bdfa-b5c871c34c65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:03.176427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 230/464] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:03.182031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62e31c-ce5b-4e26-921f-3aee93ad8c89 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:03.196763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098b987-6348-43a8-bdfa-b5c871c34c65 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:03.197102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62e31c-ce5b-4e26-921f-3aee93ad8c89 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:03.208487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa99de2-1afc-4cc4-abb9-dc6896ed0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:03.209501 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa99de2-1afc-4cc4-abb9-dc6896ed0e73 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.209947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa99de2-1afc-4cc4-abb9-dc6896ed0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.210379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa99de2-1afc-4cc4-abb9-dc6896ed0e73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.211288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa99de2-1afc-4cc4-abb9-dc6896ed0e73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:03.211782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa99de2-1afc-4cc4-abb9-dc6896ed0e73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:03.213627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa99de2-1afc-4cc4-abb9-dc6896ed0e73 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:03.217861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098b987-6348-43a8-bdfa-b5c871c34c65 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:03.229936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc76f4d-30e0-42c4-aa9c-d91de4c27096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:03.231220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc76f4d-30e0-42c4-aa9c-d91de4c27096 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.231668 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc76f4d-30e0-42c4-aa9c-d91de4c27096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.232114 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc76f4d-30e0-42c4-aa9c-d91de4c27096 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.238660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 235/465] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:03.246614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa99de2-1afc-4cc4-abb9-dc6896ed0e73 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:03.247660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc76f4d-30e0-42c4-aa9c-d91de4c27096 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:03.249846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc76f4d-30e0-42c4-aa9c-d91de4c27096 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:03.264216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa99de2-1afc-4cc4-abb9-dc6896ed0e73 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:03.277873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1e97-d788-4548-a376-519b37641c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:03.278580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1e97-d788-4548-a376-519b37641c2f admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.278853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1e97-d788-4548-a376-519b37641c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.279122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1e97-d788-4548-a376-519b37641c2f admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.279839 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1e97-d788-4548-a376-519b37641c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:03.281824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1e97-d788-4548-a376-519b37641c2f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:03.282736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ffc76f4d-30e0-42c4-aa9c-d91de4c27096 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:03.284275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 231/466] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:03.290183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc76f4d-30e0-42c4-aa9c-d91de4c27096 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:03.304786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc76f4d-30e0-42c4-aa9c-d91de4c27096 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:03.308470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 236/467] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:13:03 2022] POST /identity/v3/users => generated 248 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:03.314481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0796f-234b-4518-a197-5d2d0f38daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:03.315580 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0796f-234b-4518-a197-5d2d0f38daf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.316084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0796f-234b-4518-a197-5d2d0f38daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.316547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0796f-234b-4518-a197-5d2d0f38daf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.317670 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0796f-234b-4518-a197-5d2d0f38daf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:03.318187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0796f-234b-4518-a197-5d2d0f38daf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:03.319548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-afa0796f-234b-4518-a197-5d2d0f38daf4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:03.319548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:13:03.319548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:13:03.320839 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0796f-234b-4518-a197-5d2d0f38daf4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:03.342040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 232/468] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:03.347256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1e97-d788-4548-a376-519b37641c2f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:03.358433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1e97-d788-4548-a376-519b37641c2f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:03.364379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad9c74-d431-49b7-b2b8-a9bf6f1992f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:03.365477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad9c74-d431-49b7-b2b8-a9bf6f1992f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.365954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad9c74-d431-49b7-b2b8-a9bf6f1992f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.366462 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad9c74-d431-49b7-b2b8-a9bf6f1992f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.367430 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad9c74-d431-49b7-b2b8-a9bf6f1992f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:03.369771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad9c74-d431-49b7-b2b8-a9bf6f1992f6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:03.399964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 237/469] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:13:03 2022] POST /identity/v3/users => generated 248 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:03.816154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552adaa-4644-40a5-b21a-d0a41c0d755c None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.817153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552adaa-4644-40a5-b21a-d0a41c0d755c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.817688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552adaa-4644-40a5-b21a-d0a41c0d755c None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.819674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 233/470] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:03.825211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7da54-cdf1-49c6-bd96-26860a97da38 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.826076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7da54-cdf1-49c6-bd96-26860a97da38 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.826543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7da54-cdf1-49c6-bd96-26860a97da38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.850205 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-8bd7da54-cdf1-49c6-bd96-26860a97da38 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:03.851723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8bd7da54-cdf1-49c6-bd96-26860a97da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:03.859758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 238/471] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:03.896201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552adaa-4644-40a5-b21a-d0a41c0d755c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:03.911446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552adaa-4644-40a5-b21a-d0a41c0d755c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:03.916223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f429e6a-bd7c-42ca-8d34-4c374339fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:03.917512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f429e6a-bd7c-42ca-8d34-4c374339fec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.917991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f429e6a-bd7c-42ca-8d34-4c374339fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.918589 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f429e6a-bd7c-42ca-8d34-4c374339fec9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.934131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f429e6a-bd7c-42ca-8d34-4c374339fec9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:03.936297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f429e6a-bd7c-42ca-8d34-4c374339fec9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:03.955463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0f429e6a-bd7c-42ca-8d34-4c374339fec9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:03.957030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 234/472] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:03.962693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7da54-cdf1-49c6-bd96-26860a97da38 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:03.973184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7da54-cdf1-49c6-bd96-26860a97da38 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:03.984850 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055725c3-db40-4242-b224-f5051e620ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:03.985991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055725c3-db40-4242-b224-f5051e620ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:03.986490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055725c3-db40-4242-b224-f5051e620ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:03.986954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055725c3-db40-4242-b224-f5051e620ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:03.987926 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055725c3-db40-4242-b224-f5051e620ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:03.988460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055725c3-db40-4242-b224-f5051e620ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:03.990524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055725c3-db40-4242-b224-f5051e620ce4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:04.008201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 239/473] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:04.014584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f429e6a-bd7c-42ca-8d34-4c374339fec9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:04.028113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f429e6a-bd7c-42ca-8d34-4c374339fec9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:04.035654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a18ed-86fd-4ea7-863b-aa74691083b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:04.036647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a18ed-86fd-4ea7-863b-aa74691083b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:04.037133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a18ed-86fd-4ea7-863b-aa74691083b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:04.037626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a18ed-86fd-4ea7-863b-aa74691083b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:04.038578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a18ed-86fd-4ea7-863b-aa74691083b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:04.040869 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a18ed-86fd-4ea7-863b-aa74691083b1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:04.077165 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 235/474] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:13:04 2022] POST /identity/v3/users => generated 249 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:04.230436 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4102b-d946-4676-b0ee-924604ecffd5 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:04.231208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4102b-d946-4676-b0ee-924604ecffd5 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:04.231702 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4102b-d946-4676-b0ee-924604ecffd5 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:04.234156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 240/475] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:04.239913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b832e-63fd-4794-a8f1-a99063e4030d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:04.240517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b832e-63fd-4794-a8f1-a99063e4030d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:04.240992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b832e-63fd-4794-a8f1-a99063e4030d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:04.262389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-be7b832e-63fd-4794-a8f1-a99063e4030d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:04.264025 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-be7b832e-63fd-4794-a8f1-a99063e4030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:04.275794 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 236/476] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:04.311523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4102b-d946-4676-b0ee-924604ecffd5 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:04.328370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4102b-d946-4676-b0ee-924604ecffd5 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:04.335291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2d29d-d52f-42ef-a2e9-d2f0540b802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:04.335983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d29d-d52f-42ef-a2e9-d2f0540b802d admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:04.336254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d29d-d52f-42ef-a2e9-d2f0540b802d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:04.336519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d29d-d52f-42ef-a2e9-d2f0540b802d admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:04.337312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2d29d-d52f-42ef-a2e9-d2f0540b802d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:04.338912 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2d29d-d52f-42ef-a2e9-d2f0540b802d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:04.349487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.sql.core [None req-44b2d29d-d52f-42ef-a2e9-d2f0540b802d admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 28 01:13:04.349487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 28 01:13:04.349487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [parameters: {'id': '3440d27254424573a52473f67ab45e92', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 28 01:13:04.349487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79114) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:13:04.363993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-44b2d29d-d52f-42ef-a2e9-d2f0540b802d admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 28 01:13:04.365817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 241/477] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:13:04 2022] POST /identity/v3/roles => generated 144 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:04.371961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b832e-63fd-4794-a8f1-a99063e4030d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:04.381830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b832e-63fd-4794-a8f1-a99063e4030d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:04.387324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b32f4-8376-4de2-b5dc-7739b6cdba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:04.388444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b32f4-8376-4de2-b5dc-7739b6cdba4e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:04.388718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b32f4-8376-4de2-b5dc-7739b6cdba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:04.389040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b32f4-8376-4de2-b5dc-7739b6cdba4e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:04.400860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b32f4-8376-4de2-b5dc-7739b6cdba4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:04.408135 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-460b32f4-8376-4de2-b5dc-7739b6cdba4e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 28 01:13:04.410408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 237/478] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:13:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:04.416684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2d29d-d52f-42ef-a2e9-d2f0540b802d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:04.430151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2d29d-d52f-42ef-a2e9-d2f0540b802d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:04.434910 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5646f-6af9-4724-9254-95e2d6fccf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:04.435577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5646f-6af9-4724-9254-95e2d6fccf42 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:04.435851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5646f-6af9-4724-9254-95e2d6fccf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:04.436117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5646f-6af9-4724-9254-95e2d6fccf42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:04.436934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5646f-6af9-4724-9254-95e2d6fccf42 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:04.437255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5646f-6af9-4724-9254-95e2d6fccf42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:04.439001 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5646f-6af9-4724-9254-95e2d6fccf42 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:04.448425 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 242/479] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:05.889086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6826e6-2931-4ad7-af09-ba405b562b9c None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:05.890058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6826e6-2931-4ad7-af09-ba405b562b9c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:05.890585 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6826e6-2931-4ad7-af09-ba405b562b9c None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:05.892543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 238/480] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:05.908791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff39444-71c9-4948-881e-ca80bd1b3e0c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:05.909310 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff39444-71c9-4948-881e-ca80bd1b3e0c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:05.909385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff39444-71c9-4948-881e-ca80bd1b3e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:05.929022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-dff39444-71c9-4948-881e-ca80bd1b3e0c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:05.930250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-dff39444-71c9-4948-881e-ca80bd1b3e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:05.943365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 243/481] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:05.966767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6826e6-2931-4ad7-af09-ba405b562b9c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:05.986873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6826e6-2931-4ad7-af09-ba405b562b9c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:05.993263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f756-e4b3-4618-8174-e218fd2a5e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:05.994462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f756-e4b3-4618-8174-e218fd2a5e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:05.994953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f756-e4b3-4618-8174-e218fd2a5e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:05.995459 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f756-e4b3-4618-8174-e218fd2a5e0b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.016194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f756-e4b3-4618-8174-e218fd2a5e0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:06.023620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0aa3f756-e4b3-4618-8174-e218fd2a5e0b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:06.028557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4357ee-252f-4c5f-b437-e34ea3d1556d None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.028860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4357ee-252f-4c5f-b437-e34ea3d1556d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.029109 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4357ee-252f-4c5f-b437-e34ea3d1556d None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.029518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 239/482] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.031198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 244/483] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:06.032277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f756-e4b3-4618-8174-e218fd2a5e0b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.036386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b51b0d-95f1-4d99-8e6b-3ba68d3720c2 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.036660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b51b0d-95f1-4d99-8e6b-3ba68d3720c2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.036933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b51b0d-95f1-4d99-8e6b-3ba68d3720c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.048599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f756-e4b3-4618-8174-e218fd2a5e0b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.060917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-55b51b0d-95f1-4d99-8e6b-3ba68d3720c2 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:06.062379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-55b51b0d-95f1-4d99-8e6b-3ba68d3720c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:06.062502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f3ace-3b6f-4026-8be0-433fcc803e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.063096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f3ace-3b6f-4026-8be0-433fcc803e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.063377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f3ace-3b6f-4026-8be0-433fcc803e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.063653 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f3ace-3b6f-4026-8be0-433fcc803e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.064419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f3ace-3b6f-4026-8be0-433fcc803e25 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.064725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f3ace-3b6f-4026-8be0-433fcc803e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.066363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f3ace-3b6f-4026-8be0-433fcc803e25 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.071771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 245/484] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:13:06.080961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 240/485] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:06.086377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b51b0d-95f1-4d99-8e6b-3ba68d3720c2 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.102866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b51b0d-95f1-4d99-8e6b-3ba68d3720c2 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.113302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f83b52-eca1-43d8-9c02-e9067f191b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.114391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f83b52-eca1-43d8-9c02-e9067f191b31 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.114855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f83b52-eca1-43d8-9c02-e9067f191b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.115329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f83b52-eca1-43d8-9c02-e9067f191b31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.122298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f3ace-3b6f-4026-8be0-433fcc803e25 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.130556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f83b52-eca1-43d8-9c02-e9067f191b31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.132613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f83b52-eca1-43d8-9c02-e9067f191b31 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.138250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f3ace-3b6f-4026-8be0-433fcc803e25 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.151325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df3e1-ae00-40e5-aee6-b9aea0afd39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.151728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-58f83b52-eca1-43d8-9c02-e9067f191b31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:06.152066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df3e1-ae00-40e5-aee6-b9aea0afd39b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.152343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df3e1-ae00-40e5-aee6-b9aea0afd39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.152656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df3e1-ae00-40e5-aee6-b9aea0afd39b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.154195 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 246/486] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.159664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f83b52-eca1-43d8-9c02-e9067f191b31 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.170077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f83b52-eca1-43d8-9c02-e9067f191b31 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.175018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a307e8-16fb-401a-8e33-a026befb603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.175911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a307e8-16fb-401a-8e33-a026befb603d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.176422 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a307e8-16fb-401a-8e33-a026befb603d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.176878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a307e8-16fb-401a-8e33-a026befb603d admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.177819 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a307e8-16fb-401a-8e33-a026befb603d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.178470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a307e8-16fb-401a-8e33-a026befb603d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.180555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a307e8-16fb-401a-8e33-a026befb603d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.186218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df3e1-ae00-40e5-aee6-b9aea0afd39b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:06.193292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-755df3e1-ae00-40e5-aee6-b9aea0afd39b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:06.193968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 247/487] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:06.199329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a307e8-16fb-401a-8e33-a026befb603d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.201397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 241/488] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.213279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a307e8-16fb-401a-8e33-a026befb603d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.218134 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e1e3-f871-4be9-a016-3c7ffabb859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.219140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e1e3-f871-4be9-a016-3c7ffabb859e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.219649 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e1e3-f871-4be9-a016-3c7ffabb859e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.220103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e1e3-f871-4be9-a016-3c7ffabb859e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.223401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df3e1-ae00-40e5-aee6-b9aea0afd39b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.230081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332e1e3-f871-4be9-a016-3c7ffabb859e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.232559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332e1e3-f871-4be9-a016-3c7ffabb859e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.243638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df3e1-ae00-40e5-aee6-b9aea0afd39b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.248515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-b332e1e3-f871-4be9-a016-3c7ffabb859e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:13:06.250552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 248/489] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:06.256446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e1e3-f871-4be9-a016-3c7ffabb859e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.262031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521c607-6976-4dad-9204-7b22251de933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.262736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521c607-6976-4dad-9204-7b22251de933 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.263016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521c607-6976-4dad-9204-7b22251de933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.263288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521c607-6976-4dad-9204-7b22251de933 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.264065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521c607-6976-4dad-9204-7b22251de933 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.264379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521c607-6976-4dad-9204-7b22251de933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.266116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521c607-6976-4dad-9204-7b22251de933 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.269083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e1e3-f871-4be9-a016-3c7ffabb859e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.276027 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86a16a-360e-4eaa-b3ac-60eff06fdb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.276234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 242/490] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:06.277160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a16a-360e-4eaa-b3ac-60eff06fdb06 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.282008 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a16a-360e-4eaa-b3ac-60eff06fdb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.282187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcaeaf-922e-4721-b07d-86d96cc52961 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.282187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcaeaf-922e-4721-b07d-86d96cc52961 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.282187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcaeaf-922e-4721-b07d-86d96cc52961 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.282187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 243/491] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:06.283039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a16a-360e-4eaa-b3ac-60eff06fdb06 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.284140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86a16a-360e-4eaa-b3ac-60eff06fdb06 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.284716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86a16a-360e-4eaa-b3ac-60eff06fdb06 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.285836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcaeaf-922e-4721-b07d-86d96cc52961 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.286189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-ce86a16a-360e-4eaa-b3ac-60eff06fdb06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:06.286189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:13:06.286189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:13:06.287636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86a16a-360e-4eaa-b3ac-60eff06fdb06 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.301037 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcaeaf-922e-4721-b07d-86d96cc52961 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.306745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e7d91-0343-428b-a8af-57c370084132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.307553 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e7d91-0343-428b-a8af-57c370084132 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.307832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e7d91-0343-428b-a8af-57c370084132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.308100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e7d91-0343-428b-a8af-57c370084132 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.326987 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e7d91-0343-428b-a8af-57c370084132 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.329244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e7d91-0343-428b-a8af-57c370084132 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.348625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0b3e7d91-0343-428b-a8af-57c370084132 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:06.350880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 249/493] 10.222.0.16 () {56 vars in 1154 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:06.356306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 244/493] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.356306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e7d91-0343-428b-a8af-57c370084132 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.357051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ff91-93b1-41d2-ac25-6d157b891ff8 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.357553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ff91-93b1-41d2-ac25-6d157b891ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.358021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ff91-93b1-41d2-ac25-6d157b891ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.367504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e7d91-0343-428b-a8af-57c370084132 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.371981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb90051-aea7-4102-8ac9-26b950b1d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.373056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb90051-aea7-4102-8ac9-26b950b1d232 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.373388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb90051-aea7-4102-8ac9-26b950b1d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.373665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb90051-aea7-4102-8ac9-26b950b1d232 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.374424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb90051-aea7-4102-8ac9-26b950b1d232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.374723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb90051-aea7-4102-8ac9-26b950b1d232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.376651 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb90051-aea7-4102-8ac9-26b950b1d232 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.380481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9943ff91-93b1-41d2-ac25-6d157b891ff8 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:06.381884 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9943ff91-93b1-41d2-ac25-6d157b891ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:06.391951 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 250/495] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:06.393488 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ff91-93b1-41d2-ac25-6d157b891ff8 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.394603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 245/495] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:06.402964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ff91-93b1-41d2-ac25-6d157b891ff8 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.406815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb90051-aea7-4102-8ac9-26b950b1d232 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.407810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119796ed-0db0-441e-bd9d-4ee75fe2e61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.408661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119796ed-0db0-441e-bd9d-4ee75fe2e61f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.409119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119796ed-0db0-441e-bd9d-4ee75fe2e61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.409595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119796ed-0db0-441e-bd9d-4ee75fe2e61f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.423350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119796ed-0db0-441e-bd9d-4ee75fe2e61f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.425931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb90051-aea7-4102-8ac9-26b950b1d232 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.427962 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119796ed-0db0-441e-bd9d-4ee75fe2e61f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.434336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf19e6-5cb1-4a40-8700-6197767f7513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.435523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf19e6-5cb1-4a40-8700-6197767f7513 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.436002 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf19e6-5cb1-4a40-8700-6197767f7513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.436471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf19e6-5cb1-4a40-8700-6197767f7513 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.438019 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 251/496] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:06.438803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119796ed-0db0-441e-bd9d-4ee75fe2e61f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.450723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf19e6-5cb1-4a40-8700-6197767f7513 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.453054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf19e6-5cb1-4a40-8700-6197767f7513 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.454125 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119796ed-0db0-441e-bd9d-4ee75fe2e61f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.459184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d873e0-01c0-4541-bf69-26da92dd23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.460249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d873e0-01c0-4541-bf69-26da92dd23f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.460723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d873e0-01c0-4541-bf69-26da92dd23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.461189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d873e0-01c0-4541-bf69-26da92dd23f8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.468095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-fedf19e6-5cb1-4a40-8700-6197767f7513 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:13:06.474257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 246/497] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.474257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf19e6-5cb1-4a40-8700-6197767f7513 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.477856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d873e0-01c0-4541-bf69-26da92dd23f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:06.484607 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf19e6-5cb1-4a40-8700-6197767f7513 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.485707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-78d873e0-01c0-4541-bf69-26da92dd23f8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:06.491973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 252/498] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.492584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d873e0-01c0-4541-bf69-26da92dd23f8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.493389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec781a-9d55-4ef9-b72c-e42f3544eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.494168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec781a-9d55-4ef9-b72c-e42f3544eed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.494439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec781a-9d55-4ef9-b72c-e42f3544eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.494699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec781a-9d55-4ef9-b72c-e42f3544eed5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.507644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d873e0-01c0-4541-bf69-26da92dd23f8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.511975 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec781a-9d55-4ef9-b72c-e42f3544eed5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.513985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec781a-9d55-4ef9-b72c-e42f3544eed5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.514557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd691-ed98-4a8e-aa93-f1d9d481331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.515512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd691-ed98-4a8e-aa93-f1d9d481331d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.515935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd691-ed98-4a8e-aa93-f1d9d481331d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.516597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd691-ed98-4a8e-aa93-f1d9d481331d admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.520035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fd691-ed98-4a8e-aa93-f1d9d481331d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.520518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fd691-ed98-4a8e-aa93-f1d9d481331d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.522701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fd691-ed98-4a8e-aa93-f1d9d481331d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.535560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c4ec781a-9d55-4ef9-b72c-e42f3544eed5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:06.536945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 247/499] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.537824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec781a-9d55-4ef9-b72c-e42f3544eed5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.547189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 253/500] 10.222.0.16 () {56 vars in 1158 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:06.547189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd691-ed98-4a8e-aa93-f1d9d481331d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.557919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec781a-9d55-4ef9-b72c-e42f3544eed5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.561433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd691-ed98-4a8e-aa93-f1d9d481331d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.562486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fae9a-3f59-423e-84d2-a26723573b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.563137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fae9a-3f59-423e-84d2-a26723573b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.563413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fae9a-3f59-423e-84d2-a26723573b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.563679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fae9a-3f59-423e-84d2-a26723573b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.564524 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fae9a-3f59-423e-84d2-a26723573b73 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.564830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fae9a-3f59-423e-84d2-a26723573b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.566656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fae9a-3f59-423e-84d2-a26723573b73 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.568208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e032218-d8ca-4ad5-9efd-8b92bd7e4631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.569549 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e032218-d8ca-4ad5-9efd-8b92bd7e4631 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.570082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e032218-d8ca-4ad5-9efd-8b92bd7e4631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.570549 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e032218-d8ca-4ad5-9efd-8b92bd7e4631 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.571598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e032218-d8ca-4ad5-9efd-8b92bd7e4631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.572631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e032218-d8ca-4ad5-9efd-8b92bd7e4631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.574825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e032218-d8ca-4ad5-9efd-8b92bd7e4631 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.579475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 248/501] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:06.579475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fae9a-3f59-423e-84d2-a26723573b73 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.588506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fae9a-3f59-423e-84d2-a26723573b73 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.593285 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d44c9-5376-4999-8866-473c4499f86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.594028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d44c9-5376-4999-8866-473c4499f86f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.594461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 254/502] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:06.594688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d44c9-5376-4999-8866-473c4499f86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.595062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d44c9-5376-4999-8866-473c4499f86f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.595878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e032218-d8ca-4ad5-9efd-8b92bd7e4631 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.611687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d44c9-5376-4999-8866-473c4499f86f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.611687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d44c9-5376-4999-8866-473c4499f86f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.615409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e032218-d8ca-4ad5-9efd-8b92bd7e4631 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.626974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 249/503] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:06.628907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d44c9-5376-4999-8866-473c4499f86f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.629766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1b23f-f46a-42a7-bac7-2e6881007232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.630753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1b23f-f46a-42a7-bac7-2e6881007232 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.631238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1b23f-f46a-42a7-bac7-2e6881007232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.631655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1b23f-f46a-42a7-bac7-2e6881007232 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.638667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d44c9-5376-4999-8866-473c4499f86f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.643449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592405-7ee9-4c51-a6e7-17fa5b4df4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.644354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592405-7ee9-4c51-a6e7-17fa5b4df4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.644725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592405-7ee9-4c51-a6e7-17fa5b4df4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.645088 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592405-7ee9-4c51-a6e7-17fa5b4df4b3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.648568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1b23f-f46a-42a7-bac7-2e6881007232 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.650725 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1b23f-f46a-42a7-bac7-2e6881007232 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.652824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94592405-7ee9-4c51-a6e7-17fa5b4df4b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.654952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94592405-7ee9-4c51-a6e7-17fa5b4df4b3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.668659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-94592405-7ee9-4c51-a6e7-17fa5b4df4b3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:06.670450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-21e1b23f-f46a-42a7-bac7-2e6881007232 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:06.671908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 255/505] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.672803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1b23f-f46a-42a7-bac7-2e6881007232 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.673828 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 250/505] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.676058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592405-7ee9-4c51-a6e7-17fa5b4df4b3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.688313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592405-7ee9-4c51-a6e7-17fa5b4df4b3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.688531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1b23f-f46a-42a7-bac7-2e6881007232 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.693408 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111176e6-b9af-492a-8dd6-c59f786a287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.693883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06c61c-9dd9-47f8-a657-6cf725f0c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.694210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111176e6-b9af-492a-8dd6-c59f786a287d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.694485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111176e6-b9af-492a-8dd6-c59f786a287d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.694748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111176e6-b9af-492a-8dd6-c59f786a287d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.694851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c61c-9dd9-47f8-a657-6cf725f0c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.695318 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c61c-9dd9-47f8-a657-6cf725f0c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.695712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c61c-9dd9-47f8-a657-6cf725f0c8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.696622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06c61c-9dd9-47f8-a657-6cf725f0c8c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.696986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06c61c-9dd9-47f8-a657-6cf725f0c8c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.698236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-7c06c61c-9dd9-47f8-a657-6cf725f0c8c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:06.698236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:13:06.698236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:13:06.699609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06c61c-9dd9-47f8-a657-6cf725f0c8c8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.708108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111176e6-b9af-492a-8dd6-c59f786a287d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.710065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111176e6-b9af-492a-8dd6-c59f786a287d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.727960 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 251/506] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:06.729033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06c61c-9dd9-47f8-a657-6cf725f0c8c8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.731089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-111176e6-b9af-492a-8dd6-c59f786a287d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:06.732511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 256/507] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.737727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111176e6-b9af-492a-8dd6-c59f786a287d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.741872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06c61c-9dd9-47f8-a657-6cf725f0c8c8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.746674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc463b-44da-4d09-a2ac-9361ecb264c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.747377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc463b-44da-4d09-a2ac-9361ecb264c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.747653 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc463b-44da-4d09-a2ac-9361ecb264c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.747917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc463b-44da-4d09-a2ac-9361ecb264c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.748702 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc463b-44da-4d09-a2ac-9361ecb264c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.748995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc463b-44da-4d09-a2ac-9361ecb264c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.750848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc463b-44da-4d09-a2ac-9361ecb264c4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.753944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111176e6-b9af-492a-8dd6-c59f786a287d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.758823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5be7-8886-482b-97c0-23c5d2eaa855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.759465 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5be7-8886-482b-97c0-23c5d2eaa855 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.759740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5be7-8886-482b-97c0-23c5d2eaa855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.760438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5be7-8886-482b-97c0-23c5d2eaa855 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.761581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5be7-8886-482b-97c0-23c5d2eaa855 admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=43dd173265f24c69af4b13b61722eb51) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.761920 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5be7-8886-482b-97c0-23c5d2eaa855 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.763263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 252/508] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:06.764059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc463b-44da-4d09-a2ac-9361ecb264c4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.766027 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5be7-8886-482b-97c0-23c5d2eaa855 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.775084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 257/509] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/role_assignments?user.id=43dd173265f24c69af4b13b61722eb51&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:06.775880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5be7-8886-482b-97c0-23c5d2eaa855 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.776296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc463b-44da-4d09-a2ac-9361ecb264c4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.786593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5be7-8886-482b-97c0-23c5d2eaa855 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.791655 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f61722-d1d5-49a0-9dd3-3ae9ad4168f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.791886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe4697-5827-49e0-9163-a495e47db82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.792329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f61722-d1d5-49a0-9dd3-3ae9ad4168f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.792539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4697-5827-49e0-9163-a495e47db82d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.792698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f61722-d1d5-49a0-9dd3-3ae9ad4168f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.792842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4697-5827-49e0-9163-a495e47db82d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.792983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f61722-d1d5-49a0-9dd3-3ae9ad4168f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.793192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4697-5827-49e0-9163-a495e47db82d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.797977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f61722-d1d5-49a0-9dd3-3ae9ad4168f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.798570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f61722-d1d5-49a0-9dd3-3ae9ad4168f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.804071 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f61722-d1d5-49a0-9dd3-3ae9ad4168f3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.817586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe4697-5827-49e0-9163-a495e47db82d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.821772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe4697-5827-49e0-9163-a495e47db82d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.831924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 253/510] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:06.838557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f61722-d1d5-49a0-9dd3-3ae9ad4168f3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.857470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f61722-d1d5-49a0-9dd3-3ae9ad4168f3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.861182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-7ebe4697-5827-49e0-9163-a495e47db82d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:13:06.865442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 258/511] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.866748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbceea6-d792-48e0-baf6-e13ec651ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.867660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbceea6-d792-48e0-baf6-e13ec651ac20 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.867934 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbceea6-d792-48e0-baf6-e13ec651ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.868201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbceea6-d792-48e0-baf6-e13ec651ac20 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.877116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbceea6-d792-48e0-baf6-e13ec651ac20 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.879027 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe4697-5827-49e0-9163-a495e47db82d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.892906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbceea6-d792-48e0-baf6-e13ec651ac20 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.894180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe4697-5827-49e0-9163-a495e47db82d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.906350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d6462-d006-4d36-baf1-da388c490a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.906955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d6462-d006-4d36-baf1-da388c490a4b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.907232 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d6462-d006-4d36-baf1-da388c490a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.909807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d6462-d006-4d36-baf1-da388c490a4b admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.910711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d6462-d006-4d36-baf1-da388c490a4b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.911021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d6462-d006-4d36-baf1-da388c490a4b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.919219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d6462-d006-4d36-baf1-da388c490a4b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.924569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-6dbceea6-d792-48e0-baf6-e13ec651ac20 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:06.926293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 254/512] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:06.933692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbceea6-d792-48e0-baf6-e13ec651ac20 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.947744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbceea6-d792-48e0-baf6-e13ec651ac20 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:06.962181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde123d-2644-43cf-b044-77bf755c2a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:06.962762 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde123d-2644-43cf-b044-77bf755c2a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.963034 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde123d-2644-43cf-b044-77bf755c2a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.963351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde123d-2644-43cf-b044-77bf755c2a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.965501 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde123d-2644-43cf-b044-77bf755c2a65 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:06.965501 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde123d-2644-43cf-b044-77bf755c2a65 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:06.966677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde123d-2644-43cf-b044-77bf755c2a65 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:06.969432 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 259/513] 10.222.0.16 () {56 vars in 1158 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:06.970765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c679ae-a317-4b6c-8ca4-6f95797880f9 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.971040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c679ae-a317-4b6c-8ca4-6f95797880f9 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.971308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c679ae-a317-4b6c-8ca4-6f95797880f9 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.973659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 260/514] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:06.975278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c679ae-a317-4b6c-8ca4-6f95797880f9 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:06.984566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 255/515] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:06.985892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa856ad7-0212-4318-b3ba-f4b6f32256da None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:06.986172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa856ad7-0212-4318-b3ba-f4b6f32256da None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:06.986440 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa856ad7-0212-4318-b3ba-f4b6f32256da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:06.993722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c679ae-a317-4b6c-8ca4-6f95797880f9 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.000486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505576c9-3b20-404c-b0cd-8e182c6bb53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.001173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505576c9-3b20-404c-b0cd-8e182c6bb53e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.001461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505576c9-3b20-404c-b0cd-8e182c6bb53e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.001704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505576c9-3b20-404c-b0cd-8e182c6bb53e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.004841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-aa856ad7-0212-4318-b3ba-f4b6f32256da None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:07.006067 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-aa856ad7-0212-4318-b3ba-f4b6f32256da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:07.010162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505576c9-3b20-404c-b0cd-8e182c6bb53e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.011988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505576c9-3b20-404c-b0cd-8e182c6bb53e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.022474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 256/517] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:07.023645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa856ad7-0212-4318-b3ba-f4b6f32256da None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.025303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 261/517] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:07.035966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa856ad7-0212-4318-b3ba-f4b6f32256da None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.038435 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505576c9-3b20-404c-b0cd-8e182c6bb53e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.047967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505576c9-3b20-404c-b0cd-8e182c6bb53e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.052838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276da83-aaf4-4749-a0d8-605237c5c4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.053636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276da83-aaf4-4749-a0d8-605237c5c4be admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.053906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276da83-aaf4-4749-a0d8-605237c5c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.054183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276da83-aaf4-4749-a0d8-605237c5c4be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.055061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276da83-aaf4-4749-a0d8-605237c5c4be admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=36ec2950259d4ed0925d7a19a6217af2) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.055368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276da83-aaf4-4749-a0d8-605237c5c4be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.055568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f47b-bf94-4ff7-99b4-9fe126d2f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.056618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f47b-bf94-4ff7-99b4-9fe126d2f74b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.057127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f47b-bf94-4ff7-99b4-9fe126d2f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.057258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276da83-aaf4-4749-a0d8-605237c5c4be admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.057709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f47b-bf94-4ff7-99b4-9fe126d2f74b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.063481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 257/518] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/role_assignments?user.id=36ec2950259d4ed0925d7a19a6217af2&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:07.071035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276da83-aaf4-4749-a0d8-605237c5c4be admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.078279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7f47b-bf94-4ff7-99b4-9fe126d2f74b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.082308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c7f47b-bf94-4ff7-99b4-9fe126d2f74b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.091117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276da83-aaf4-4749-a0d8-605237c5c4be admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.102989 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601a9a7-0804-4298-9e83-292b88f45d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.104770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601a9a7-0804-4298-9e83-292b88f45d9e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.106041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601a9a7-0804-4298-9e83-292b88f45d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.106784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601a9a7-0804-4298-9e83-292b88f45d9e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.120309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-41c7f47b-bf94-4ff7-99b4-9fe126d2f74b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:07.124500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 262/519] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:07.130947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f47b-bf94-4ff7-99b4-9fe126d2f74b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.141123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f47b-bf94-4ff7-99b4-9fe126d2f74b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.142194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601a9a7-0804-4298-9e83-292b88f45d9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:07.145609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed01ed-ba4a-4db6-a4bb-12e4a7df77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.146260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed01ed-ba4a-4db6-a4bb-12e4a7df77f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.146535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed01ed-ba4a-4db6-a4bb-12e4a7df77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.146805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed01ed-ba4a-4db6-a4bb-12e4a7df77f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.147536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed01ed-ba4a-4db6-a4bb-12e4a7df77f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.147833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed01ed-ba4a-4db6-a4bb-12e4a7df77f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.157379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed01ed-ba4a-4db6-a4bb-12e4a7df77f8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.161183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-6601a9a7-0804-4298-9e83-292b88f45d9e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:07.163235 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 258/520] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:07.169763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 263/521] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:07.172243 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601a9a7-0804-4298-9e83-292b88f45d9e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.176351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed01ed-ba4a-4db6-a4bb-12e4a7df77f8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.186753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed01ed-ba4a-4db6-a4bb-12e4a7df77f8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.188324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601a9a7-0804-4298-9e83-292b88f45d9e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.191503 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828ef5-ab59-4cda-8fa2-a2500c513506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.192321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828ef5-ab59-4cda-8fa2-a2500c513506 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.192595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828ef5-ab59-4cda-8fa2-a2500c513506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.192863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1828ef5-ab59-4cda-8fa2-a2500c513506 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.194986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69582d94-398e-47eb-ae75-923579286fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.196008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69582d94-398e-47eb-ae75-923579286fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.196525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69582d94-398e-47eb-ae75-923579286fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.197018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69582d94-398e-47eb-ae75-923579286fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.203720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1828ef5-ab59-4cda-8fa2-a2500c513506 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.203720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1828ef5-ab59-4cda-8fa2-a2500c513506 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.204436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69582d94-398e-47eb-ae75-923579286fcc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.204960 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69582d94-398e-47eb-ae75-923579286fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.206904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69582d94-398e-47eb-ae75-923579286fcc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.219390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-b1828ef5-ab59-4cda-8fa2-a2500c513506 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:07.223692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 264/522] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:07.226280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 259/523] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:07.232611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828ef5-ab59-4cda-8fa2-a2500c513506 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.234395 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69582d94-398e-47eb-ae75-923579286fcc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.244148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1828ef5-ab59-4cda-8fa2-a2500c513506 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.249367 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1b130-4e6d-4d3b-8a02-dc56d1625b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.250238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b130-4e6d-4d3b-8a02-dc56d1625b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.250513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b130-4e6d-4d3b-8a02-dc56d1625b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.250986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1b130-4e6d-4d3b-8a02-dc56d1625b86 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.252062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69582d94-398e-47eb-ae75-923579286fcc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.265262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a5c9-32f0-4962-a9da-2db351607b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.265469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1b130-4e6d-4d3b-8a02-dc56d1625b86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.265469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1b130-4e6d-4d3b-8a02-dc56d1625b86 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.270176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a5c9-32f0-4962-a9da-2db351607b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.270462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a5c9-32f0-4962-a9da-2db351607b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.270731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a5c9-32f0-4962-a9da-2db351607b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.271565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36a5c9-32f0-4962-a9da-2db351607b52 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.271872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36a5c9-32f0-4962-a9da-2db351607b52 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.273770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36a5c9-32f0-4962-a9da-2db351607b52 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.284360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-0cb1b130-4e6d-4d3b-8a02-dc56d1625b86 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:07.290054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 265/524] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:07.291751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1b130-4e6d-4d3b-8a02-dc56d1625b86 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.295082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 260/525] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:07.302977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a5c9-32f0-4962-a9da-2db351607b52 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.303667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1b130-4e6d-4d3b-8a02-dc56d1625b86 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.314596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b5902-1228-4be7-bc5d-47b64ca93b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.315249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b5902-1228-4be7-bc5d-47b64ca93b9b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.315523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b5902-1228-4be7-bc5d-47b64ca93b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.315785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b5902-1228-4be7-bc5d-47b64ca93b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.316518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b5902-1228-4be7-bc5d-47b64ca93b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.316815 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b5902-1228-4be7-bc5d-47b64ca93b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.318437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b5902-1228-4be7-bc5d-47b64ca93b9b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.323474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a5c9-32f0-4962-a9da-2db351607b52 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.335697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 266/526] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:07.336928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b5902-1228-4be7-bc5d-47b64ca93b9b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.341910 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb7223-b07c-4f22-881f-a92ad79a02bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.342578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb7223-b07c-4f22-881f-a92ad79a02bc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.342861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb7223-b07c-4f22-881f-a92ad79a02bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.343140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb7223-b07c-4f22-881f-a92ad79a02bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.343989 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb7223-b07c-4f22-881f-a92ad79a02bc admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=a19c46c2ecd746d7a6e10c09d706a675) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.344302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb7223-b07c-4f22-881f-a92ad79a02bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.346168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb7223-b07c-4f22-881f-a92ad79a02bc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.346542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b5902-1228-4be7-bc5d-47b64ca93b9b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.351282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb1e37-ee69-45e5-9b3b-5d3922d5f752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.352052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb1e37-ee69-45e5-9b3b-5d3922d5f752 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.352325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb1e37-ee69-45e5-9b3b-5d3922d5f752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.352691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb1e37-ee69-45e5-9b3b-5d3922d5f752 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.361096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb1e37-ee69-45e5-9b3b-5d3922d5f752 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.363137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb1e37-ee69-45e5-9b3b-5d3922d5f752 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.363491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 261/527] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/role_assignments?user.id=a19c46c2ecd746d7a6e10c09d706a675&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 259 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:07.377726 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-ddcb1e37-ee69-45e5-9b3b-5d3922d5f752 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:13:07.378980 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 267/528] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:07.385138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb7223-b07c-4f22-881f-a92ad79a02bc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.395373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb7223-b07c-4f22-881f-a92ad79a02bc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.400223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19712b2b-ed1b-485b-8cd1-7fcccfd84425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.400991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19712b2b-ed1b-485b-8cd1-7fcccfd84425 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.401309 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19712b2b-ed1b-485b-8cd1-7fcccfd84425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.401581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19712b2b-ed1b-485b-8cd1-7fcccfd84425 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.402595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19712b2b-ed1b-485b-8cd1-7fcccfd84425 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.402902 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19712b2b-ed1b-485b-8cd1-7fcccfd84425 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.404013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-19712b2b-ed1b-485b-8cd1-7fcccfd84425 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:07.404013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:13:07.404013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:13:07.405308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19712b2b-ed1b-485b-8cd1-7fcccfd84425 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.451570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 262/529] 10.222.0.16 () {56 vars in 1160 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:07.452909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb1e37-ee69-45e5-9b3b-5d3922d5f752 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.463609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb1e37-ee69-45e5-9b3b-5d3922d5f752 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.468644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d96d08-fb55-4645-abe1-0754150768a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.469435 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d96d08-fb55-4645-abe1-0754150768a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.469711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d96d08-fb55-4645-abe1-0754150768a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.469977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d96d08-fb55-4645-abe1-0754150768a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.481170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d96d08-fb55-4645-abe1-0754150768a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.481512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752b144-3339-44ed-aad8-403dce3fe57c None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.481512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752b144-3339-44ed-aad8-403dce3fe57c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.481512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752b144-3339-44ed-aad8-403dce3fe57c None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.483129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d96d08-fb55-4645-abe1-0754150768a5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.483679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 263/530] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:13:07.489841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a11d9-2128-4ca0-a236-b3d409d4740e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.501349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a11d9-2128-4ca0-a236-b3d409d4740e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.501349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a11d9-2128-4ca0-a236-b3d409d4740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.503282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 268/531] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:07.510696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d96d08-fb55-4645-abe1-0754150768a5 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.530665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d96d08-fb55-4645-abe1-0754150768a5 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.533008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-bf3a11d9-2128-4ca0-a236-b3d409d4740e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:07.536542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bf3a11d9-2128-4ca0-a236-b3d409d4740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:07.538902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0bf12-0465-4005-988f-67f4c55ee785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.540708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0bf12-0465-4005-988f-67f4c55ee785 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.540983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0bf12-0465-4005-988f-67f4c55ee785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.541272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0bf12-0465-4005-988f-67f4c55ee785 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.555036 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 264/532] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:07.561677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0bf12-0465-4005-988f-67f4c55ee785 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.563600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0bf12-0465-4005-988f-67f4c55ee785 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.581761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-e0d0bf12-0465-4005-988f-67f4c55ee785 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:07.586999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 269/533] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:07.589158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a11d9-2128-4ca0-a236-b3d409d4740e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.596187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0bf12-0465-4005-988f-67f4c55ee785 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.601179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a11d9-2128-4ca0-a236-b3d409d4740e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.610927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc9f57-f105-492f-82b8-52824684c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.611646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9f57-f105-492f-82b8-52824684c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.611965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9f57-f105-492f-82b8-52824684c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.612237 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc9f57-f105-492f-82b8-52824684c8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.612976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc9f57-f105-492f-82b8-52824684c8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.613294 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc9f57-f105-492f-82b8-52824684c8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.616326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc9f57-f105-492f-82b8-52824684c8c8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.618983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0bf12-0465-4005-988f-67f4c55ee785 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.624318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c29bb8-b4db-4164-abce-24a3c73218a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.625115 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c29bb8-b4db-4164-abce-24a3c73218a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.625421 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c29bb8-b4db-4164-abce-24a3c73218a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.625775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c29bb8-b4db-4164-abce-24a3c73218a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.637708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 265/534] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:07.642400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c29bb8-b4db-4164-abce-24a3c73218a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.644311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c29bb8-b4db-4164-abce-24a3c73218a0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.656509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc9f57-f105-492f-82b8-52824684c8c8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.663733 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-d5c29bb8-b4db-4164-abce-24a3c73218a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:07.665242 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 270/535] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:07.672947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c29bb8-b4db-4164-abce-24a3c73218a0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.679457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc9f57-f105-492f-82b8-52824684c8c8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.682722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c29bb8-b4db-4164-abce-24a3c73218a0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.687092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f65f6-c7f7-4497-bd9e-18c94726058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.687834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f65f6-c7f7-4497-bd9e-18c94726058c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.688107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f65f6-c7f7-4497-bd9e-18c94726058c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.688375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f65f6-c7f7-4497-bd9e-18c94726058c admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.689153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f65f6-c7f7-4497-bd9e-18c94726058c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.689477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f65f6-c7f7-4497-bd9e-18c94726058c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.691673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f65f6-c7f7-4497-bd9e-18c94726058c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.693925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9593a4-d674-4d1c-a32e-1d31730ee664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.694742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9593a4-d674-4d1c-a32e-1d31730ee664 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.695025 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9593a4-d674-4d1c-a32e-1d31730ee664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.695299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9593a4-d674-4d1c-a32e-1d31730ee664 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.705089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 271/536] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:07.710421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9593a4-d674-4d1c-a32e-1d31730ee664 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.712397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9593a4-d674-4d1c-a32e-1d31730ee664 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.714467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f65f6-c7f7-4497-bd9e-18c94726058c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.724837 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f65f6-c7f7-4497-bd9e-18c94726058c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.729463 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ad6e2-22a1-4279-95af-bdb8f322037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.730127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ad6e2-22a1-4279-95af-bdb8f322037a admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.730402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ad6e2-22a1-4279-95af-bdb8f322037a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.730731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ad6e2-22a1-4279-95af-bdb8f322037a admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.731470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ad6e2-22a1-4279-95af-bdb8f322037a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.733915 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ad6e2-22a1-4279-95af-bdb8f322037a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.740818 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-1f9593a4-d674-4d1c-a32e-1d31730ee664 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:07.749697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 266/537] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:07.759962 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 272/538] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:13:07 2022] POST /identity/v3/users => generated 247 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:07.761085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9593a4-d674-4d1c-a32e-1d31730ee664 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.772152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9593a4-d674-4d1c-a32e-1d31730ee664 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.777009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb7297-f8dc-462d-a854-9aee533507b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.777813 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb7297-f8dc-462d-a854-9aee533507b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.778134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb7297-f8dc-462d-a854-9aee533507b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.778423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb7297-f8dc-462d-a854-9aee533507b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.779315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb7297-f8dc-462d-a854-9aee533507b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.779623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb7297-f8dc-462d-a854-9aee533507b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.781621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb7297-f8dc-462d-a854-9aee533507b1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.795847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 267/539] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:07.802768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ad6e2-22a1-4279-95af-bdb8f322037a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:07.814560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ad6e2-22a1-4279-95af-bdb8f322037a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:07.820249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82ce3a-8f47-4324-a666-e37ecb881050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:07.820958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82ce3a-8f47-4324-a666-e37ecb881050 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:07.821250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82ce3a-8f47-4324-a666-e37ecb881050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:07.821591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82ce3a-8f47-4324-a666-e37ecb881050 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:07.822448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82ce3a-8f47-4324-a666-e37ecb881050 admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=84470027e2824dc3a4b735d086de1300) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:07.822753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82ce3a-8f47-4324-a666-e37ecb881050 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:07.824911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82ce3a-8f47-4324-a666-e37ecb881050 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:07.831852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 273/540] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:07 2022] GET /identity/v3/role_assignments?user.id=84470027e2824dc3a4b735d086de1300&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:09.403275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01690391-7bcd-4197-b65e-38fb2244f5f7 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.404329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01690391-7bcd-4197-b65e-38fb2244f5f7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.404809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01690391-7bcd-4197-b65e-38fb2244f5f7 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.407092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 268/541] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:09.412683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c74f4-ccd9-49a4-9164-4184743f8acb None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.413097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c74f4-ccd9-49a4-9164-4184743f8acb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.413291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c74f4-ccd9-49a4-9164-4184743f8acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.442590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-8d7c74f4-ccd9-49a4-9164-4184743f8acb None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:09.443856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8d7c74f4-ccd9-49a4-9164-4184743f8acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:09.452538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 274/542] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:09.483895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01690391-7bcd-4197-b65e-38fb2244f5f7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:09.503057 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01690391-7bcd-4197-b65e-38fb2244f5f7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:09.513267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5923-2373-4a89-b66c-11cfb8806956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:09.514069 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5923-2373-4a89-b66c-11cfb8806956 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.514400 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5923-2373-4a89-b66c-11cfb8806956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.514674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5923-2373-4a89-b66c-11cfb8806956 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.538153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c5923-2373-4a89-b66c-11cfb8806956 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:09.545152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-1f9c5923-2373-4a89-b66c-11cfb8806956 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:09.546697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 269/543] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:09.552547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c74f4-ccd9-49a4-9164-4184743f8acb None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:09.566287 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c74f4-ccd9-49a4-9164-4184743f8acb None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:09.578817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6a05-baf6-47dc-9477-f765bb34156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:09.579512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6a05-baf6-47dc-9477-f765bb34156a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.579791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6a05-baf6-47dc-9477-f765bb34156a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.580065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6a05-baf6-47dc-9477-f765bb34156a admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.580853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6a05-baf6-47dc-9477-f765bb34156a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:09.581164 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6a05-baf6-47dc-9477-f765bb34156a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:09.582840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6a05-baf6-47dc-9477-f765bb34156a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:09.601043 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 275/544] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:09.606245 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5923-2373-4a89-b66c-11cfb8806956 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:09.632522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5923-2373-4a89-b66c-11cfb8806956 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:09.639221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01764a50-ecda-4c65-84fa-4f86111f71d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:09.640014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764a50-ecda-4c65-84fa-4f86111f71d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.640291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764a50-ecda-4c65-84fa-4f86111f71d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.640556 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764a50-ecda-4c65-84fa-4f86111f71d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.659565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01764a50-ecda-4c65-84fa-4f86111f71d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:09.661618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01764a50-ecda-4c65-84fa-4f86111f71d1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:09.685825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-01764a50-ecda-4c65-84fa-4f86111f71d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:09.687078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 270/545] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:09.692862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6a05-baf6-47dc-9477-f765bb34156a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:09.710346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6a05-baf6-47dc-9477-f765bb34156a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:09.717608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1f0ed-d0d8-45e1-95d8-034676d83ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:09.718266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f0ed-d0d8-45e1-95d8-034676d83ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.718546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f0ed-d0d8-45e1-95d8-034676d83ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.718817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f0ed-d0d8-45e1-95d8-034676d83ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.719577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1f0ed-d0d8-45e1-95d8-034676d83ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:09.719886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1f0ed-d0d8-45e1-95d8-034676d83ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:09.721535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1f0ed-d0d8-45e1-95d8-034676d83ed2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:09.737875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606514c-a6a2-4d80-848a-faa8e73cae9f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.738193 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606514c-a6a2-4d80-848a-faa8e73cae9f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.738420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606514c-a6a2-4d80-848a-faa8e73cae9f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.740635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 271/546] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:09.744923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 276/547] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:09.746797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8785df-2e0e-472b-bb7d-5ddfed6799ac None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.747080 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8785df-2e0e-472b-bb7d-5ddfed6799ac None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.747351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8785df-2e0e-472b-bb7d-5ddfed6799ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.751054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1f0ed-d0d8-45e1-95d8-034676d83ed2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:09.770770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1f0ed-d0d8-45e1-95d8-034676d83ed2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:09.778333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20c86f-bf32-43c2-a1b0-8ba6ac88649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:09.779140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20c86f-bf32-43c2-a1b0-8ba6ac88649f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.779413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20c86f-bf32-43c2-a1b0-8ba6ac88649f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.779680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20c86f-bf32-43c2-a1b0-8ba6ac88649f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.786226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-bb8785df-2e0e-472b-bb7d-5ddfed6799ac None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:09.787411 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bb8785df-2e0e-472b-bb7d-5ddfed6799ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:09.796541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20c86f-bf32-43c2-a1b0-8ba6ac88649f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:09.801287 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20c86f-bf32-43c2-a1b0-8ba6ac88649f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:09.806147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 272/548] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:09.818443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-ca20c86f-bf32-43c2-a1b0-8ba6ac88649f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:13:09.820225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 277/549] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jan 28 01:13:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:09.825883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8785df-2e0e-472b-bb7d-5ddfed6799ac None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:09.835583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8785df-2e0e-472b-bb7d-5ddfed6799ac None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:09.844745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d66d-ba81-403f-b90d-a0823ec27f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:09.846774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d66d-ba81-403f-b90d-a0823ec27f7e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.846774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d66d-ba81-403f-b90d-a0823ec27f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.846774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1d66d-ba81-403f-b90d-a0823ec27f7e admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.847017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1d66d-ba81-403f-b90d-a0823ec27f7e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:09.847205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1d66d-ba81-403f-b90d-a0823ec27f7e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:09.849627 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1d66d-ba81-403f-b90d-a0823ec27f7e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:09.877084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20c86f-bf32-43c2-a1b0-8ba6ac88649f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:09.884514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 273/550] 10.222.0.16 () {56 vars in 1154 bytes} [Fri Jan 28 01:13:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:09.890198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d66d-ba81-403f-b90d-a0823ec27f7e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:09.898118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20c86f-bf32-43c2-a1b0-8ba6ac88649f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:09.907455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5c503-997f-436d-b1c2-f833b09650ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:09.908054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1d66d-ba81-403f-b90d-a0823ec27f7e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:09.909438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c503-997f-436d-b1c2-f833b09650ac admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.910294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c503-997f-436d-b1c2-f833b09650ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.910939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c503-997f-436d-b1c2-f833b09650ac admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.917425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b721b-4849-4be6-ad76-760299810ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:09.919673 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b721b-4849-4be6-ad76-760299810ece admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.919981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b721b-4849-4be6-ad76-760299810ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.920248 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b721b-4849-4be6-ad76-760299810ece admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.936092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5c503-997f-436d-b1c2-f833b09650ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:09.945114 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b721b-4849-4be6-ad76-760299810ece admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:09.947064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b721b-4849-4be6-ad76-760299810ece admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:09.950038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-84e5c503-997f-436d-b1c2-f833b09650ac admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:09.955877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 278/551] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:09.961615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5c503-997f-436d-b1c2-f833b09650ac admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:09.976830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5c503-997f-436d-b1c2-f833b09650ac admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:09.982706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-368b721b-4849-4be6-ad76-760299810ece admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:09.986326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 274/552] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:09.987002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c522012-4722-4285-9cca-d6cbbe7f5868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:09.987810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c522012-4722-4285-9cca-d6cbbe7f5868 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:09.988080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c522012-4722-4285-9cca-d6cbbe7f5868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:09.988348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c522012-4722-4285-9cca-d6cbbe7f5868 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:09.989148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c522012-4722-4285-9cca-d6cbbe7f5868 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:09.989468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c522012-4722-4285-9cca-d6cbbe7f5868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:09.991914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b721b-4849-4be6-ad76-760299810ece admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:09.997537 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c522012-4722-4285-9cca-d6cbbe7f5868 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.010889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b721b-4849-4be6-ad76-760299810ece admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.014189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 279/553] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:10.020391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c522012-4722-4285-9cca-d6cbbe7f5868 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.023823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd62f09-3313-4c24-be82-a01c24a885da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.024988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd62f09-3313-4c24-be82-a01c24a885da admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.025355 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd62f09-3313-4c24-be82-a01c24a885da admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.025636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd62f09-3313-4c24-be82-a01c24a885da admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.026393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd62f09-3313-4c24-be82-a01c24a885da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.026750 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd62f09-3313-4c24-be82-a01c24a885da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.028506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd62f09-3313-4c24-be82-a01c24a885da admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.034224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c522012-4722-4285-9cca-d6cbbe7f5868 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.039830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1aac4-94b8-4f99-9840-8e70bcce8e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.040609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1aac4-94b8-4f99-9840-8e70bcce8e98 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.040883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1aac4-94b8-4f99-9840-8e70bcce8e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.041148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1aac4-94b8-4f99-9840-8e70bcce8e98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.041754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 275/554] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.043308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5b63-32f5-4bc9-80ed-ccb94bfc2dc2 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.043643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5b63-32f5-4bc9-80ed-ccb94bfc2dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.043921 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea5b63-32f5-4bc9-80ed-ccb94bfc2dc2 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.046185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 276/555] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:10.047007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5b63-32f5-4bc9-80ed-ccb94bfc2dc2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.052933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1aac4-94b8-4f99-9840-8e70bcce8e98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.054992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1aac4-94b8-4f99-9840-8e70bcce8e98 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.059847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea5b63-32f5-4bc9-80ed-ccb94bfc2dc2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.064558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e0fca-aeea-4406-9ceb-9dad20c29080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.065452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e0fca-aeea-4406-9ceb-9dad20c29080 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.065734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e0fca-aeea-4406-9ceb-9dad20c29080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.066011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e0fca-aeea-4406-9ceb-9dad20c29080 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.073439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e0fca-aeea-4406-9ceb-9dad20c29080 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.073877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-d7a1aac4-94b8-4f99-9840-8e70bcce8e98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:10.075490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 280/556] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:10.075606 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e0fca-aeea-4406-9ceb-9dad20c29080 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.076709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056548-a6fb-4d65-a3f4-1221f11957e9 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.076981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056548-a6fb-4d65-a3f4-1221f11957e9 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.077265 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6056548-a6fb-4d65-a3f4-1221f11957e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.097569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ce5e0fca-aeea-4406-9ceb-9dad20c29080 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:10.099550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 277/557] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:10.100302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d6056548-a6fb-4d65-a3f4-1221f11957e9 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:10.100475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e0fca-aeea-4406-9ceb-9dad20c29080 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.101616 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d6056548-a6fb-4d65-a3f4-1221f11957e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:10.110355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 281/558] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:10.111147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6056548-a6fb-4d65-a3f4-1221f11957e9 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.111778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e0fca-aeea-4406-9ceb-9dad20c29080 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.116479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa01a76-78e7-4936-af4a-fe7ef4b1b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.117273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa01a76-78e7-4936-af4a-fe7ef4b1b4fd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.117572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa01a76-78e7-4936-af4a-fe7ef4b1b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.117848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa01a76-78e7-4936-af4a-fe7ef4b1b4fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.118726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa01a76-78e7-4936-af4a-fe7ef4b1b4fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.119079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa01a76-78e7-4936-af4a-fe7ef4b1b4fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.120286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6056548-a6fb-4d65-a3f4-1221f11957e9 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.120827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa01a76-78e7-4936-af4a-fe7ef4b1b4fd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.124954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1d57b-75d7-43d3-907d-e76a9b78ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.125727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1d57b-75d7-43d3-907d-e76a9b78ab01 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.126115 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1d57b-75d7-43d3-907d-e76a9b78ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.126477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1d57b-75d7-43d3-907d-e76a9b78ab01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.127364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1d57b-75d7-43d3-907d-e76a9b78ab01 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.127758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1d57b-75d7-43d3-907d-e76a9b78ab01 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.128888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-22b1d57b-75d7-43d3-907d-e76a9b78ab01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:10.128888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:13:10.128888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:13:10.130242 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1d57b-75d7-43d3-907d-e76a9b78ab01 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.133978 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 278/559] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.139425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa01a76-78e7-4936-af4a-fe7ef4b1b4fd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.149267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 282/560] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.149559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa01a76-78e7-4936-af4a-fe7ef4b1b4fd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.154285 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758888-764b-4408-8ffc-a9ef948ff083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.154739 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1d57b-75d7-43d3-907d-e76a9b78ab01 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.155109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758888-764b-4408-8ffc-a9ef948ff083 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.155392 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758888-764b-4408-8ffc-a9ef948ff083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.155668 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58758888-764b-4408-8ffc-a9ef948ff083 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.164758 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58758888-764b-4408-8ffc-a9ef948ff083 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.166789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58758888-764b-4408-8ffc-a9ef948ff083 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.167184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1d57b-75d7-43d3-907d-e76a9b78ab01 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.172740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f47c0-368c-4454-9e42-26b02806321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.174015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f47c0-368c-4454-9e42-26b02806321d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.174489 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f47c0-368c-4454-9e42-26b02806321d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.174997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f47c0-368c-4454-9e42-26b02806321d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.182965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-58758888-764b-4408-8ffc-a9ef948ff083 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:13:10.184341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 279/561] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:10.185086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758888-764b-4408-8ffc-a9ef948ff083 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.189197 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f47c0-368c-4454-9e42-26b02806321d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:10.197064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-dc9f47c0-368c-4454-9e42-26b02806321d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:10.198955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 283/562] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:10.200068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58758888-764b-4408-8ffc-a9ef948ff083 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.200221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f47c0-368c-4454-9e42-26b02806321d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.204603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f33f-bf4f-440e-bcf8-cc7868712513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.205605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f33f-bf4f-440e-bcf8-cc7868712513 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.205917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f33f-bf4f-440e-bcf8-cc7868712513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.206188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709f33f-bf4f-440e-bcf8-cc7868712513 admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/43dd173265f24c69af4b13b61722eb51/roles/13ec9c0076334780847c0f750f4af8f4` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.211190 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f47c0-368c-4454-9e42-26b02806321d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.216481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259595a-9a5b-4fd9-9d62-8f42c2865b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.217484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259595a-9a5b-4fd9-9d62-8f42c2865b48 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.217896 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259595a-9a5b-4fd9-9d62-8f42c2865b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.218400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259595a-9a5b-4fd9-9d62-8f42c2865b48 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.219468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259595a-9a5b-4fd9-9d62-8f42c2865b48 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.219941 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259595a-9a5b-4fd9-9d62-8f42c2865b48 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.222103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259595a-9a5b-4fd9-9d62-8f42c2865b48 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.227998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709f33f-bf4f-440e-bcf8-cc7868712513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=43dd173265f24c69af4b13b61722eb51, role_id=13ec9c0076334780847c0f750f4af8f4)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.230765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709f33f-bf4f-440e-bcf8-cc7868712513 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.242522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 284/563] 10.222.0.16 () {56 vars in 1158 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.243675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259595a-9a5b-4fd9-9d62-8f42c2865b48 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.251939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 280/564] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:10 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/43dd173265f24c69af4b13b61722eb51/roles/13ec9c0076334780847c0f750f4af8f4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:10.252787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f33f-bf4f-440e-bcf8-cc7868712513 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.258229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259595a-9a5b-4fd9-9d62-8f42c2865b48 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.317968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709f33f-bf4f-440e-bcf8-cc7868712513 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.322642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad305-dc3f-4de9-a88d-f28c801137d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.323447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad305-dc3f-4de9-a88d-f28c801137d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.323730 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad305-dc3f-4de9-a88d-f28c801137d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.324050 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad305-dc3f-4de9-a88d-f28c801137d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.335805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ad305-dc3f-4de9-a88d-f28c801137d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.337588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cba1ef-ed3e-4047-853e-6cd1ac23cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.337878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ad305-dc3f-4de9-a88d-f28c801137d5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.338756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cba1ef-ed3e-4047-853e-6cd1ac23cc5c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.339225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cba1ef-ed3e-4047-853e-6cd1ac23cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.339728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cba1ef-ed3e-4047-853e-6cd1ac23cc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.341252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cba1ef-ed3e-4047-853e-6cd1ac23cc5c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.341800 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cba1ef-ed3e-4047-853e-6cd1ac23cc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.343746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cba1ef-ed3e-4047-853e-6cd1ac23cc5c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.355923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-863ad305-dc3f-4de9-a88d-f28c801137d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:10.357267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 281/565] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:10.363625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 285/566] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.370728 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad305-dc3f-4de9-a88d-f28c801137d5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.370939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cba1ef-ed3e-4047-853e-6cd1ac23cc5c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.387023 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad305-dc3f-4de9-a88d-f28c801137d5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.390599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cba1ef-ed3e-4047-853e-6cd1ac23cc5c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.396842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6eb74e-23ff-4515-86b7-5057c5075f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.398620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eb74e-23ff-4515-86b7-5057c5075f78 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.398899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eb74e-23ff-4515-86b7-5057c5075f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.399170 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6eb74e-23ff-4515-86b7-5057c5075f78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.400388 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d0ae0-25ae-457b-893f-70743233f481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.401877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0ae0-25ae-457b-893f-70743233f481 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.402151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0ae0-25ae-457b-893f-70743233f481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.402525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0ae0-25ae-457b-893f-70743233f481 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.405693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d0ae0-25ae-457b-893f-70743233f481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.406015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d0ae0-25ae-457b-893f-70743233f481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.408186 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d0ae0-25ae-457b-893f-70743233f481 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.427538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 286/567] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.428132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6eb74e-23ff-4515-86b7-5057c5075f78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.429670 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6eb74e-23ff-4515-86b7-5057c5075f78 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.437298 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27a5a5-e81c-4a11-82d0-fdec44aef069 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.437879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27a5a5-e81c-4a11-82d0-fdec44aef069 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.438358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27a5a5-e81c-4a11-82d0-fdec44aef069 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.440380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 287/568] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:13:10.446034 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27a5a5-e81c-4a11-82d0-fdec44aef069 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.456732 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-7c6eb74e-23ff-4515-86b7-5057c5075f78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:10.458431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 282/569] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:10.459856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d027a-6175-49cb-a24c-7275a1100777 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.460139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d027a-6175-49cb-a24c-7275a1100777 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.460415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d027a-6175-49cb-a24c-7275a1100777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.460783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27a5a5-e81c-4a11-82d0-fdec44aef069 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.466145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a6c5-e171-4e4c-9312-54b18353b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.467475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a6c5-e171-4e4c-9312-54b18353b93a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.468216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a6c5-e171-4e4c-9312-54b18353b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.468773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5a6c5-e171-4e4c-9312-54b18353b93a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.482148 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f82d027a-6175-49cb-a24c-7275a1100777 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:10.483477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f82d027a-6175-49cb-a24c-7275a1100777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:10.483627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5a6c5-e171-4e4c-9312-54b18353b93a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.486681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5a6c5-e171-4e4c-9312-54b18353b93a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.497265 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 283/570] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:10.497265 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d027a-6175-49cb-a24c-7275a1100777 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.503179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-78f5a6c5-e171-4e4c-9312-54b18353b93a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:10.504622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 288/571] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:10.509618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d027a-6175-49cb-a24c-7275a1100777 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.511993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a6c5-e171-4e4c-9312-54b18353b93a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.514699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405660b-027a-4a20-8d9a-e8a45e72056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.515363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405660b-027a-4a20-8d9a-e8a45e72056a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.515642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405660b-027a-4a20-8d9a-e8a45e72056a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.515916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405660b-027a-4a20-8d9a-e8a45e72056a admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.516659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405660b-027a-4a20-8d9a-e8a45e72056a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.516960 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405660b-027a-4a20-8d9a-e8a45e72056a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.518614 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405660b-027a-4a20-8d9a-e8a45e72056a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.522909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5a6c5-e171-4e4c-9312-54b18353b93a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.528138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10128c-8562-4bce-b380-195ba6020575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.528920 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10128c-8562-4bce-b380-195ba6020575 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.529117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10128c-8562-4bce-b380-195ba6020575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.529397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10128c-8562-4bce-b380-195ba6020575 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.530283 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10128c-8562-4bce-b380-195ba6020575 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.530596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10128c-8562-4bce-b380-195ba6020575 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.532551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10128c-8562-4bce-b380-195ba6020575 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.532662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 284/572] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.533614 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405660b-027a-4a20-8d9a-e8a45e72056a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.546822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405660b-027a-4a20-8d9a-e8a45e72056a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.547832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 289/573] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.548589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10128c-8562-4bce-b380-195ba6020575 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.552934 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0293d-578e-4541-b205-452ed10f9231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.554059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0293d-578e-4541-b205-452ed10f9231 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.554588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0293d-578e-4541-b205-452ed10f9231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.554949 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0293d-578e-4541-b205-452ed10f9231 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.558990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10128c-8562-4bce-b380-195ba6020575 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.563918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90496370-1f9d-4800-ab7d-a30916c9a691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.564693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90496370-1f9d-4800-ab7d-a30916c9a691 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.564963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90496370-1f9d-4800-ab7d-a30916c9a691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.565246 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90496370-1f9d-4800-ab7d-a30916c9a691 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.567547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0293d-578e-4541-b205-452ed10f9231 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:10.573679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90496370-1f9d-4800-ab7d-a30916c9a691 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.574569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-f1c0293d-578e-4541-b205-452ed10f9231 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:10.575964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90496370-1f9d-4800-ab7d-a30916c9a691 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.576068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 285/574] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:10.576715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0293d-578e-4541-b205-452ed10f9231 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.590894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0293d-578e-4541-b205-452ed10f9231 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.591074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-90496370-1f9d-4800-ab7d-a30916c9a691 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:13:10.592534 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 290/575] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:10.593323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90496370-1f9d-4800-ab7d-a30916c9a691 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.595423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c85e-56ce-4f91-9c2b-5515b6e1f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.596306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c85e-56ce-4f91-9c2b-5515b6e1f4be admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.596588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c85e-56ce-4f91-9c2b-5515b6e1f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.596862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4c85e-56ce-4f91-9c2b-5515b6e1f4be admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/36ec2950259d4ed0925d7a19a6217af2/roles/13ec9c0076334780847c0f750f4af8f4` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.607536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90496370-1f9d-4800-ab7d-a30916c9a691 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.621875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4c85e-56ce-4f91-9c2b-5515b6e1f4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=36ec2950259d4ed0925d7a19a6217af2, role_id=13ec9c0076334780847c0f750f4af8f4)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.626149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4c85e-56ce-4f91-9c2b-5515b6e1f4be admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.626259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08ed9d-6659-4018-9ea9-7478bd5c0125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.626812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08ed9d-6659-4018-9ea9-7478bd5c0125 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.627092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08ed9d-6659-4018-9ea9-7478bd5c0125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.627361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08ed9d-6659-4018-9ea9-7478bd5c0125 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.628124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08ed9d-6659-4018-9ea9-7478bd5c0125 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.628430 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08ed9d-6659-4018-9ea9-7478bd5c0125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.631663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08ed9d-6659-4018-9ea9-7478bd5c0125 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.645362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 291/576] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.646573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08ed9d-6659-4018-9ea9-7478bd5c0125 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.653391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 286/577] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:10 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/36ec2950259d4ed0925d7a19a6217af2/roles/13ec9c0076334780847c0f750f4af8f4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:10.654569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c85e-56ce-4f91-9c2b-5515b6e1f4be admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.658628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08ed9d-6659-4018-9ea9-7478bd5c0125 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.730624 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650c9ad-1a1d-4f73-a742-a5aadd3fdbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.731752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650c9ad-1a1d-4f73-a742-a5aadd3fdbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.732288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650c9ad-1a1d-4f73-a742-a5aadd3fdbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.732770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650c9ad-1a1d-4f73-a742-a5aadd3fdbf7 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.734055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650c9ad-1a1d-4f73-a742-a5aadd3fdbf7 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.734556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650c9ad-1a1d-4f73-a742-a5aadd3fdbf7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.736853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650c9ad-1a1d-4f73-a742-a5aadd3fdbf7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.761115 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 292/578] 10.222.0.16 () {56 vars in 1158 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.767288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650c9ad-1a1d-4f73-a742-a5aadd3fdbf7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.778791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650c9ad-1a1d-4f73-a742-a5aadd3fdbf7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.784153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e8fc3-3e2b-44a2-b515-9e11acae16bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.785371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8fc3-3e2b-44a2-b515-9e11acae16bd admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.785904 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8fc3-3e2b-44a2-b515-9e11acae16bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.786902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8fc3-3e2b-44a2-b515-9e11acae16bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.800119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e8fc3-3e2b-44a2-b515-9e11acae16bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.802494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e8fc3-3e2b-44a2-b515-9e11acae16bd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.819743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4c85e-56ce-4f91-9c2b-5515b6e1f4be admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.822619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-8a4e8fc3-3e2b-44a2-b515-9e11acae16bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:10.824198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 293/579] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:10.830220 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e8fc3-3e2b-44a2-b515-9e11acae16bd admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.841406 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e8fc3-3e2b-44a2-b515-9e11acae16bd admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.841991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4ae23-d195-4ddc-8a5a-e28bfcbba50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.842803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4ae23-d195-4ddc-8a5a-e28bfcbba50d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.843083 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4ae23-d195-4ddc-8a5a-e28bfcbba50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.843349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4ae23-d195-4ddc-8a5a-e28bfcbba50d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.848000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e0108-d670-45e0-838f-09d15efa9078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.848909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e0108-d670-45e0-838f-09d15efa9078 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.849480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e0108-d670-45e0-838f-09d15efa9078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.849944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e0108-d670-45e0-838f-09d15efa9078 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.851407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e0108-d670-45e0-838f-09d15efa9078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.851969 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e0108-d670-45e0-838f-09d15efa9078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.853948 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e0108-d670-45e0-838f-09d15efa9078 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.863272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4ae23-d195-4ddc-8a5a-e28bfcbba50d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.865195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4ae23-d195-4ddc-8a5a-e28bfcbba50d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.868460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 294/580] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:10.874786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e0108-d670-45e0-838f-09d15efa9078 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.886013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e0108-d670-45e0-838f-09d15efa9078 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.892217 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b349fb-f148-483b-ad4c-f097a638a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.893445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b349fb-f148-483b-ad4c-f097a638a561 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.893930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b349fb-f148-483b-ad4c-f097a638a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.894469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b349fb-f148-483b-ad4c-f097a638a561 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.902668 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b349fb-f148-483b-ad4c-f097a638a561 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.904764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-aee4ae23-d195-4ddc-8a5a-e28bfcbba50d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:10.905175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b349fb-f148-483b-ad4c-f097a638a561 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.906024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 287/581] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:10.914268 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4ae23-d195-4ddc-8a5a-e28bfcbba50d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.921359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-d4b349fb-f148-483b-ad4c-f097a638a561 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:10.923245 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 295/582] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:10.929335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b349fb-f148-483b-ad4c-f097a638a561 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.936100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4ae23-d195-4ddc-8a5a-e28bfcbba50d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.940249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b349fb-f148-483b-ad4c-f097a638a561 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.947738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34d678-1fe3-4a05-8066-fc7bffe28615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.947932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94135813-bb5a-4d83-bb8f-039c169d10c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.948509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94135813-bb5a-4d83-bb8f-039c169d10c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.948775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94135813-bb5a-4d83-bb8f-039c169d10c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.949044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94135813-bb5a-4d83-bb8f-039c169d10c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.949594 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34d678-1fe3-4a05-8066-fc7bffe28615 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.950076 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34d678-1fe3-4a05-8066-fc7bffe28615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.950242 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94135813-bb5a-4d83-bb8f-039c169d10c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.950507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94135813-bb5a-4d83-bb8f-039c169d10c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.950914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34d678-1fe3-4a05-8066-fc7bffe28615 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.951834 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34d678-1fe3-4a05-8066-fc7bffe28615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:10.952339 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34d678-1fe3-4a05-8066-fc7bffe28615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:10.952504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94135813-bb5a-4d83-bb8f-039c169d10c2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.954408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34d678-1fe3-4a05-8066-fc7bffe28615 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:10.966352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 296/583] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.967967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24641b54-a4cd-489d-9699-20bb77de5c42 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.968258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24641b54-a4cd-489d-9699-20bb77de5c42 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.968636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24641b54-a4cd-489d-9699-20bb77de5c42 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.970893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 297/584] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:10.973576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24641b54-a4cd-489d-9699-20bb77de5c42 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:10.975231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 288/585] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:10.977527 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4475-5390-4b8e-a780-e66cf28ca7e4 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.977900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4475-5390-4b8e-a780-e66cf28ca7e4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:10.978176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4475-5390-4b8e-a780-e66cf28ca7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:10.993068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24641b54-a4cd-489d-9699-20bb77de5c42 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:10.998257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef1588-dd47-47cf-a6cb-c27e07a97ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:10.999033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c1ac4475-5390-4b8e-a780-e66cf28ca7e4 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:10.999475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1588-dd47-47cf-a6cb-c27e07a97ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:10.999889 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1588-dd47-47cf-a6cb-c27e07a97ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.000293 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1588-dd47-47cf-a6cb-c27e07a97ad8 admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/a19c46c2ecd746d7a6e10c09d706a675/roles/13ec9c0076334780847c0f750f4af8f4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.000694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c1ac4475-5390-4b8e-a780-e66cf28ca7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:11.009022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 289/586] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:13:11.010135 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac4475-5390-4b8e-a780-e66cf28ca7e4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.022266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac4475-5390-4b8e-a780-e66cf28ca7e4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.023775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef1588-dd47-47cf-a6cb-c27e07a97ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=a19c46c2ecd746d7a6e10c09d706a675, role_id=13ec9c0076334780847c0f750f4af8f4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.026594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef1588-dd47-47cf-a6cb-c27e07a97ad8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.027164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27fca1-09d2-487d-b2a9-b7875d7666c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.028206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fca1-09d2-487d-b2a9-b7875d7666c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.028611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fca1-09d2-487d-b2a9-b7875d7666c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.028972 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fca1-09d2-487d-b2a9-b7875d7666c3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.038984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27fca1-09d2-487d-b2a9-b7875d7666c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.041307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27fca1-09d2-487d-b2a9-b7875d7666c3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.045461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 298/587] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:10 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/a19c46c2ecd746d7a6e10c09d706a675/roles/13ec9c0076334780847c0f750f4af8f4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:11.055811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef1588-dd47-47cf-a6cb-c27e07a97ad8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.063249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-dc27fca1-09d2-487d-b2a9-b7875d7666c3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:13:11.064934 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 290/588] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:11.070604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27fca1-09d2-487d-b2a9-b7875d7666c3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.081201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27fca1-09d2-487d-b2a9-b7875d7666c3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.149685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef1588-dd47-47cf-a6cb-c27e07a97ad8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.162174 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10859c-cbf7-4823-8951-66e0fe7e3588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.163802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10859c-cbf7-4823-8951-66e0fe7e3588 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.164089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10859c-cbf7-4823-8951-66e0fe7e3588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.164367 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10859c-cbf7-4823-8951-66e0fe7e3588 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.184261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10859c-cbf7-4823-8951-66e0fe7e3588 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:11.197304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-2f10859c-cbf7-4823-8951-66e0fe7e3588 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:11.200820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b309c32-aa57-4cf5-9bf4-c94ad4350d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.201805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b309c32-aa57-4cf5-9bf4-c94ad4350d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.202293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b309c32-aa57-4cf5-9bf4-c94ad4350d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.202761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b309c32-aa57-4cf5-9bf4-c94ad4350d69 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.203811 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b309c32-aa57-4cf5-9bf4-c94ad4350d69 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:11.204314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b309c32-aa57-4cf5-9bf4-c94ad4350d69 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.206445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b309c32-aa57-4cf5-9bf4-c94ad4350d69 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.208228 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 299/589] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:11.217056 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10859c-cbf7-4823-8951-66e0fe7e3588 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.233714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10859c-cbf7-4823-8951-66e0fe7e3588 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.248316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 291/590] 10.222.0.16 () {56 vars in 1160 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:11.253182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6120e59-7621-457f-b80b-100367a62dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.256266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120e59-7621-457f-b80b-100367a62dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.258794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120e59-7621-457f-b80b-100367a62dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.259119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120e59-7621-457f-b80b-100367a62dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.259937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6120e59-7621-457f-b80b-100367a62dc7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:11.260448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6120e59-7621-457f-b80b-100367a62dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.261521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b309c32-aa57-4cf5-9bf4-c94ad4350d69 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.272679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b309c32-aa57-4cf5-9bf4-c94ad4350d69 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.273388 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6120e59-7621-457f-b80b-100367a62dc7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.280296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d7153-59fe-40c3-9e37-2028398e4c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.281096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7153-59fe-40c3-9e37-2028398e4c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.281450 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7153-59fe-40c3-9e37-2028398e4c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.281725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7153-59fe-40c3-9e37-2028398e4c61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.285077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 300/591] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:11.295658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6120e59-7621-457f-b80b-100367a62dc7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.298292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d7153-59fe-40c3-9e37-2028398e4c61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.300145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d7153-59fe-40c3-9e37-2028398e4c61 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.310807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6120e59-7621-457f-b80b-100367a62dc7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.315967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60200d3b-8d48-4a70-97d7-59d7d362327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.316858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200d3b-8d48-4a70-97d7-59d7d362327b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.317140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200d3b-8d48-4a70-97d7-59d7d362327b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.317530 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200d3b-8d48-4a70-97d7-59d7d362327b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.322769 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-1e3d7153-59fe-40c3-9e37-2028398e4c61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:11.324373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 292/592] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:11.329101 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60200d3b-8d48-4a70-97d7-59d7d362327b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.330862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d7153-59fe-40c3-9e37-2028398e4c61 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.331199 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60200d3b-8d48-4a70-97d7-59d7d362327b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.342476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d7153-59fe-40c3-9e37-2028398e4c61 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.348851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45f6ba-d962-44a9-8bbf-60d8371d718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.349836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45f6ba-d962-44a9-8bbf-60d8371d718c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.350314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45f6ba-d962-44a9-8bbf-60d8371d718c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.350778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45f6ba-d962-44a9-8bbf-60d8371d718c admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.351707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45f6ba-d962-44a9-8bbf-60d8371d718c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:11.352226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45f6ba-d962-44a9-8bbf-60d8371d718c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.354250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45f6ba-d962-44a9-8bbf-60d8371d718c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.354677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-60200d3b-8d48-4a70-97d7-59d7d362327b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:11.356103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 301/593] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:11.362226 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60200d3b-8d48-4a70-97d7-59d7d362327b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.368883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 293/594] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:11.371960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60200d3b-8d48-4a70-97d7-59d7d362327b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.373626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45f6ba-d962-44a9-8bbf-60d8371d718c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.376437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866dd77-7204-44f0-bb28-2beec4c011b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.377081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866dd77-7204-44f0-bb28-2beec4c011b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.377388 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866dd77-7204-44f0-bb28-2beec4c011b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.377655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866dd77-7204-44f0-bb28-2beec4c011b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.378376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866dd77-7204-44f0-bb28-2beec4c011b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:11.378670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866dd77-7204-44f0-bb28-2beec4c011b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.380266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866dd77-7204-44f0-bb28-2beec4c011b3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.385878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45f6ba-d962-44a9-8bbf-60d8371d718c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.392550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460eff94-e5a4-4ee2-8a15-22c741a9cbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.393639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eff94-e5a4-4ee2-8a15-22c741a9cbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.394021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 302/595] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:11.394333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eff94-e5a4-4ee2-8a15-22c741a9cbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.394805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eff94-e5a4-4ee2-8a15-22c741a9cbf5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.401274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866dd77-7204-44f0-bb28-2beec4c011b3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.416165 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460eff94-e5a4-4ee2-8a15-22c741a9cbf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.419493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866dd77-7204-44f0-bb28-2beec4c011b3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.420282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460eff94-e5a4-4ee2-8a15-22c741a9cbf5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.428156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b7b51-c5df-44d5-8003-001adc95eaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.430254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b7b51-c5df-44d5-8003-001adc95eaaf admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.430529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b7b51-c5df-44d5-8003-001adc95eaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.430797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b7b51-c5df-44d5-8003-001adc95eaaf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.447746 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-460eff94-e5a4-4ee2-8a15-22c741a9cbf5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:11.449378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 294/596] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:11.449875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b7b51-c5df-44d5-8003-001adc95eaaf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.452085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b7b51-c5df-44d5-8003-001adc95eaaf admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.454727 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460eff94-e5a4-4ee2-8a15-22c741a9cbf5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.470112 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460eff94-e5a4-4ee2-8a15-22c741a9cbf5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.470267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-d18b7b51-c5df-44d5-8003-001adc95eaaf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:13:11.471474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 303/597] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:11.477643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b7b51-c5df-44d5-8003-001adc95eaaf admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.487929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b7b51-c5df-44d5-8003-001adc95eaaf admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.489941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3e924-ab25-4d90-81d0-f798db7df4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.490617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3e924-ab25-4d90-81d0-f798db7df4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.490895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3e924-ab25-4d90-81d0-f798db7df4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.491167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3e924-ab25-4d90-81d0-f798db7df4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.491980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3e924-ab25-4d90-81d0-f798db7df4c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:11.492283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3e924-ab25-4d90-81d0-f798db7df4c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.493300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2d24-1175-4c05-9f0b-3797b4f08056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.493991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2d24-1175-4c05-9f0b-3797b4f08056 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.494164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3e924-ab25-4d90-81d0-f798db7df4c7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.494256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2d24-1175-4c05-9f0b-3797b4f08056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.494518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2d24-1175-4c05-9f0b-3797b4f08056 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.495417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e2d24-1175-4c05-9f0b-3797b4f08056 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:11.495712 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e2d24-1175-4c05-9f0b-3797b4f08056 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.497817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e2d24-1175-4c05-9f0b-3797b4f08056 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.516862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 295/598] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:11.517299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 304/599] 10.222.0.16 () {56 vars in 1156 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:11.522421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3e924-ab25-4d90-81d0-f798db7df4c7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.522696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2d24-1175-4c05-9f0b-3797b4f08056 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.536614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2d24-1175-4c05-9f0b-3797b4f08056 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.543220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3e924-ab25-4d90-81d0-f798db7df4c7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.549178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7a71-6815-43cb-b31e-306b79618913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.550190 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7a71-6815-43cb-b31e-306b79618913 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.551440 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb710c71-e85f-4ac4-b8fb-e89260ee2f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.551808 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7a71-6815-43cb-b31e-306b79618913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.552085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7a71-6815-43cb-b31e-306b79618913 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.553505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb710c71-e85f-4ac4-b8fb-e89260ee2f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.553778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb710c71-e85f-4ac4-b8fb-e89260ee2f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.554047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb710c71-e85f-4ac4-b8fb-e89260ee2f58 admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/84470027e2824dc3a4b735d086de1300/roles/13ec9c0076334780847c0f750f4af8f4` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.570138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7a71-6815-43cb-b31e-306b79618913 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.571961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7a71-6815-43cb-b31e-306b79618913 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.583981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb710c71-e85f-4ac4-b8fb-e89260ee2f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=84470027e2824dc3a4b735d086de1300, role_id=13ec9c0076334780847c0f750f4af8f4)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.586637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb710c71-e85f-4ac4-b8fb-e89260ee2f58 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.590843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 305/600] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 01:13:11.597941 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7a71-6815-43cb-b31e-306b79618913 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.611132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 296/601] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:11 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/84470027e2824dc3a4b735d086de1300/roles/13ec9c0076334780847c0f750f4af8f4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:11.614734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7a71-6815-43cb-b31e-306b79618913 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.712968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42979ceb-76a5-4ff8-84e9-9f4d8ac7b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.713874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42979ceb-76a5-4ff8-84e9-9f4d8ac7b1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.714154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42979ceb-76a5-4ff8-84e9-9f4d8ac7b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.714472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42979ceb-76a5-4ff8-84e9-9f4d8ac7b1c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.730994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42979ceb-76a5-4ff8-84e9-9f4d8ac7b1c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.732970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42979ceb-76a5-4ff8-84e9-9f4d8ac7b1c1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.755214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-42979ceb-76a5-4ff8-84e9-9f4d8ac7b1c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:11.756554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 306/602] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:11.762523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb710c71-e85f-4ac4-b8fb-e89260ee2f58 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.773804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb710c71-e85f-4ac4-b8fb-e89260ee2f58 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.778453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00144049-f92c-4068-94d5-c33ccaed92bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.779171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144049-f92c-4068-94d5-c33ccaed92bf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.779450 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144049-f92c-4068-94d5-c33ccaed92bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.779721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144049-f92c-4068-94d5-c33ccaed92bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.780568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00144049-f92c-4068-94d5-c33ccaed92bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:11.780867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00144049-f92c-4068-94d5-c33ccaed92bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.782600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00144049-f92c-4068-94d5-c33ccaed92bf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.796416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 297/603] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:11.801853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42979ceb-76a5-4ff8-84e9-9f4d8ac7b1c1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.812011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42979ceb-76a5-4ff8-84e9-9f4d8ac7b1c1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.816660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737124f-a385-43e8-91ae-b121dacdb4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.817465 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737124f-a385-43e8-91ae-b121dacdb4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.817797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737124f-a385-43e8-91ae-b121dacdb4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.818068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737124f-a385-43e8-91ae-b121dacdb4a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.825366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737124f-a385-43e8-91ae-b121dacdb4a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.827443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737124f-a385-43e8-91ae-b121dacdb4a9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.840732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-2737124f-a385-43e8-91ae-b121dacdb4a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:11.842331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 307/604] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:11.850332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00144049-f92c-4068-94d5-c33ccaed92bf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.860347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00144049-f92c-4068-94d5-c33ccaed92bf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.864941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e210d-0064-4502-8ad4-ad7e4d78943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.865658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e210d-0064-4502-8ad4-ad7e4d78943b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.865937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e210d-0064-4502-8ad4-ad7e4d78943b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.866211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e210d-0064-4502-8ad4-ad7e4d78943b admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.867130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e210d-0064-4502-8ad4-ad7e4d78943b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:11.867445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e210d-0064-4502-8ad4-ad7e4d78943b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.869477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e210d-0064-4502-8ad4-ad7e4d78943b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.885426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 298/605] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:11.891179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737124f-a385-43e8-91ae-b121dacdb4a9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:11.902066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737124f-a385-43e8-91ae-b121dacdb4a9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:11.906722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898cd4f-8723-4acd-8f6d-f8b8c939afb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:11.907413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898cd4f-8723-4acd-8f6d-f8b8c939afb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:11.907686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898cd4f-8723-4acd-8f6d-f8b8c939afb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:11.907954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898cd4f-8723-4acd-8f6d-f8b8c939afb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:11.908844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898cd4f-8723-4acd-8f6d-f8b8c939afb8 admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=ca65456d336b4c3898831af80e6435a6) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:11.909148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898cd4f-8723-4acd-8f6d-f8b8c939afb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:11.911113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898cd4f-8723-4acd-8f6d-f8b8c939afb8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:11.917168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 308/606] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:11 2022] GET /identity/v3/role_assignments?user.id=ca65456d336b4c3898831af80e6435a6&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:13.117951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5be8d-1855-4377-9bb3-1192bd98ded8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.118474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5be8d-1855-4377-9bb3-1192bd98ded8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.118474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5be8d-1855-4377-9bb3-1192bd98ded8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.120391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 299/607] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:13.127807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a56cc-8f33-4de7-b664-8db2349d8682 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.128238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a56cc-8f33-4de7-b664-8db2349d8682 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.128401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a56cc-8f33-4de7-b664-8db2349d8682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.158475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-484a56cc-8f33-4de7-b664-8db2349d8682 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:13.159693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-484a56cc-8f33-4de7-b664-8db2349d8682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:13.167706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 309/608] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:13.229824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5be8d-1855-4377-9bb3-1192bd98ded8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.243884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5be8d-1855-4377-9bb3-1192bd98ded8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.252466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe710b-c91b-400d-a966-b2688918d4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.253265 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe710b-c91b-400d-a966-b2688918d4aa admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.253547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe710b-c91b-400d-a966-b2688918d4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.253818 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe710b-c91b-400d-a966-b2688918d4aa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.267795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe710b-c91b-400d-a966-b2688918d4aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:13.274676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-3afe710b-c91b-400d-a966-b2688918d4aa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:13.276418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 300/609] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:13.285475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a56cc-8f33-4de7-b664-8db2349d8682 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.307372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a56cc-8f33-4de7-b664-8db2349d8682 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.318606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aec73-1dc8-4ec1-a6bf-072710271a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.319699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aec73-1dc8-4ec1-a6bf-072710271a29 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.320243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aec73-1dc8-4ec1-a6bf-072710271a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.320723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aec73-1dc8-4ec1-a6bf-072710271a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.322162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aec73-1dc8-4ec1-a6bf-072710271a29 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:13.322693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aec73-1dc8-4ec1-a6bf-072710271a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:13.329713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aec73-1dc8-4ec1-a6bf-072710271a29 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:13.344872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 310/610] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:13.351943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe710b-c91b-400d-a966-b2688918d4aa admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.370442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe710b-c91b-400d-a966-b2688918d4aa admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.380119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80459e7-e576-41f8-84b5-2d1641bb8270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.380953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80459e7-e576-41f8-84b5-2d1641bb8270 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.381297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80459e7-e576-41f8-84b5-2d1641bb8270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.381571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80459e7-e576-41f8-84b5-2d1641bb8270 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.401402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80459e7-e576-41f8-84b5-2d1641bb8270 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:13.403412 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80459e7-e576-41f8-84b5-2d1641bb8270 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:13.421711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c80459e7-e576-41f8-84b5-2d1641bb8270 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:13.423015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 301/611] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:13.431695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aec73-1dc8-4ec1-a6bf-072710271a29 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.461872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aec73-1dc8-4ec1-a6bf-072710271a29 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.472231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db455fc7-c341-4902-bc80-e0eb06eef9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.473671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db455fc7-c341-4902-bc80-e0eb06eef9ba admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.474157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db455fc7-c341-4902-bc80-e0eb06eef9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.474630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db455fc7-c341-4902-bc80-e0eb06eef9ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.475919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db455fc7-c341-4902-bc80-e0eb06eef9ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:13.476458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db455fc7-c341-4902-bc80-e0eb06eef9ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:13.479393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db455fc7-c341-4902-bc80-e0eb06eef9ba admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:13.508709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 311/612] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:13.516266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80459e7-e576-41f8-84b5-2d1641bb8270 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.532168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80459e7-e576-41f8-84b5-2d1641bb8270 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.539338 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a548-7fb8-4866-a46a-e998d5479712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.540169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a548-7fb8-4866-a46a-e998d5479712 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.540508 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a548-7fb8-4866-a46a-e998d5479712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.540786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a548-7fb8-4866-a46a-e998d5479712 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.558156 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308a548-7fb8-4866-a46a-e998d5479712 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:13.560428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308a548-7fb8-4866-a46a-e998d5479712 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:13.580305 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-8308a548-7fb8-4866-a46a-e998d5479712 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:13:13.581773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 302/613] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:13.590192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db455fc7-c341-4902-bc80-e0eb06eef9ba admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.602507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cd9f6-5751-407f-9be1-3a9967fa54c1 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.602790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cd9f6-5751-407f-9be1-3a9967fa54c1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.603115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cd9f6-5751-407f-9be1-3a9967fa54c1 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.605255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 303/614] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:13:13.612268 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1aad-91e0-4cc5-b310-96c8309e3232 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.612549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1aad-91e0-4cc5-b310-96c8309e3232 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.612826 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1aad-91e0-4cc5-b310-96c8309e3232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.618002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db455fc7-c341-4902-bc80-e0eb06eef9ba admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.634204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa193-22b6-4a7a-9329-61b0315f73bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.635267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa193-22b6-4a7a-9329-61b0315f73bf admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.635706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa193-22b6-4a7a-9329-61b0315f73bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.636149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa193-22b6-4a7a-9329-61b0315f73bf admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.637700 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffa193-22b6-4a7a-9329-61b0315f73bf admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:13.638130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffa193-22b6-4a7a-9329-61b0315f73bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:13.641094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffa193-22b6-4a7a-9329-61b0315f73bf admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:13.641760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-591b1aad-91e0-4cc5-b310-96c8309e3232 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:13.643531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-591b1aad-91e0-4cc5-b310-96c8309e3232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:13.662539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 304/615] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:13:13.672806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 312/616] 10.222.0.16 () {56 vars in 1154 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:13.680132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b1aad-91e0-4cc5-b310-96c8309e3232 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.694437 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b1aad-91e0-4cc5-b310-96c8309e3232 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.704130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554efa3f-ab35-42e7-a74c-045132b122d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.704933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554efa3f-ab35-42e7-a74c-045132b122d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.705368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554efa3f-ab35-42e7-a74c-045132b122d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.705800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554efa3f-ab35-42e7-a74c-045132b122d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.717259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa193-22b6-4a7a-9329-61b0315f73bf admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.718024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554efa3f-ab35-42e7-a74c-045132b122d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:13.721322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554efa3f-ab35-42e7-a74c-045132b122d3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:13.739586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa193-22b6-4a7a-9329-61b0315f73bf admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.741398 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 305/617] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:13.746131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554efa3f-ab35-42e7-a74c-045132b122d3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.758811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b743e-2e9c-4cfe-9ffa-346aa73f6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.760061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b743e-2e9c-4cfe-9ffa-346aa73f6c6a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.760534 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b743e-2e9c-4cfe-9ffa-346aa73f6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.760992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b743e-2e9c-4cfe-9ffa-346aa73f6c6a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.773130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554efa3f-ab35-42e7-a74c-045132b122d3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.791661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22adfef-1263-4e77-ae22-02a1149e7bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.792888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22adfef-1263-4e77-ae22-02a1149e7bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.793438 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22adfef-1263-4e77-ae22-02a1149e7bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.793855 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22adfef-1263-4e77-ae22-02a1149e7bf8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.796399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b743e-2e9c-4cfe-9ffa-346aa73f6c6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:13.815204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-d88b743e-2e9c-4cfe-9ffa-346aa73f6c6a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:13.821748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 313/618] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:13.822279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22adfef-1263-4e77-ae22-02a1149e7bf8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:13.826026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22adfef-1263-4e77-ae22-02a1149e7bf8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:13.834005 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b743e-2e9c-4cfe-9ffa-346aa73f6c6a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.860468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b743e-2e9c-4cfe-9ffa-346aa73f6c6a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.861984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c22adfef-1263-4e77-ae22-02a1149e7bf8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:13.869323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 306/619] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:13.873293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22adfef-1263-4e77-ae22-02a1149e7bf8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.882196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290024-16c6-4ccd-ba91-8ff4ae92e7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.883334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290024-16c6-4ccd-ba91-8ff4ae92e7ed admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.883789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290024-16c6-4ccd-ba91-8ff4ae92e7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.884235 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290024-16c6-4ccd-ba91-8ff4ae92e7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.885692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1290024-16c6-4ccd-ba91-8ff4ae92e7ed admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:13.886201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1290024-16c6-4ccd-ba91-8ff4ae92e7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:13.889219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1290024-16c6-4ccd-ba91-8ff4ae92e7ed admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:13.904184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22adfef-1263-4e77-ae22-02a1149e7bf8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.926609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 314/620] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:13.927608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbe57-9409-4bd4-baad-53bf2fbf77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.928664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbe57-9409-4bd4-baad-53bf2fbf77fa admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.929091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbe57-9409-4bd4-baad-53bf2fbf77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.929535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbe57-9409-4bd4-baad-53bf2fbf77fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:13.930726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacbe57-9409-4bd4-baad-53bf2fbf77fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:13.931205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacbe57-9409-4bd4-baad-53bf2fbf77fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:13.933951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacbe57-9409-4bd4-baad-53bf2fbf77fa admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:13.941397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290024-16c6-4ccd-ba91-8ff4ae92e7ed admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.965058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290024-16c6-4ccd-ba91-8ff4ae92e7ed admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:13.972171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 307/621] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:13.979390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbe57-9409-4bd4-baad-53bf2fbf77fa admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:13.991362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b594d-c870-4c73-b64c-807d31243c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:13.992752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b594d-c870-4c73-b64c-807d31243c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:13.993256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b594d-c870-4c73-b64c-807d31243c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:13.993790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b594d-c870-4c73-b64c-807d31243c14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.013404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbe57-9409-4bd4-baad-53bf2fbf77fa admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.020004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b594d-c870-4c73-b64c-807d31243c14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.022831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b594d-c870-4c73-b64c-807d31243c14 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.036349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceba11-e9e7-4b96-adc6-28a5f91e5261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.037602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceba11-e9e7-4b96-adc6-28a5f91e5261 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.037985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceba11-e9e7-4b96-adc6-28a5f91e5261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.038356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceba11-e9e7-4b96-adc6-28a5f91e5261 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.053678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dceba11-e9e7-4b96-adc6-28a5f91e5261 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.056082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dceba11-e9e7-4b96-adc6-28a5f91e5261 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.070219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-d93b594d-c870-4c73-b64c-807d31243c14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:14.070706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0dceba11-e9e7-4b96-adc6-28a5f91e5261 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:14.076538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 315/623] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:14.076538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1ad15-3b38-4770-874f-c4c370f3f517 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.076538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1ad15-3b38-4770-874f-c4c370f3f517 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.076538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1ad15-3b38-4770-874f-c4c370f3f517 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.076970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 308/623] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:14.077960 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceba11-e9e7-4b96-adc6-28a5f91e5261 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.079798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 316/624] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:14.081087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1ad15-3b38-4770-874f-c4c370f3f517 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.092316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceba11-e9e7-4b96-adc6-28a5f91e5261 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.097118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e587f-aa60-475e-922a-ff52013f0894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.098335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e587f-aa60-475e-922a-ff52013f0894 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.098799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e587f-aa60-475e-922a-ff52013f0894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.099255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e587f-aa60-475e-922a-ff52013f0894 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.100239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e587f-aa60-475e-922a-ff52013f0894 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.100734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e587f-aa60-475e-922a-ff52013f0894 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.102759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e587f-aa60-475e-922a-ff52013f0894 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.104914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1ad15-3b38-4770-874f-c4c370f3f517 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.114607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998391ed-28a0-4c28-8b77-5bc3a56f5638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.115736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998391ed-28a0-4c28-8b77-5bc3a56f5638 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.116211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998391ed-28a0-4c28-8b77-5bc3a56f5638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.116498 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 309/625] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.116657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998391ed-28a0-4c28-8b77-5bc3a56f5638 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.118070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826ade4-b9f8-42c1-b116-460115be2a15 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.118496 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998391ed-28a0-4c28-8b77-5bc3a56f5638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.118843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998391ed-28a0-4c28-8b77-5bc3a56f5638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.119170 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826ade4-b9f8-42c1-b116-460115be2a15 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.119619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826ade4-b9f8-42c1-b116-460115be2a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.122280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998391ed-28a0-4c28-8b77-5bc3a56f5638 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.139544 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f826ade4-b9f8-42c1-b116-460115be2a15 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:14.141354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f826ade4-b9f8-42c1-b116-460115be2a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:14.150406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 310/627] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:14.150635 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 317/627] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.157391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998391ed-28a0-4c28-8b77-5bc3a56f5638 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.158660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826ade4-b9f8-42c1-b116-460115be2a15 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.172032 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998391ed-28a0-4c28-8b77-5bc3a56f5638 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.175045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826ade4-b9f8-42c1-b116-460115be2a15 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.184894 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde67f0-84cd-4dd4-95b5-e4ec7f798fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.186156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde67f0-84cd-4dd4-95b5-e4ec7f798fec admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.186828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde67f0-84cd-4dd4-95b5-e4ec7f798fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.188278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48274576-43d3-4a04-8e13-b1dee3c2a900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.188908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde67f0-84cd-4dd4-95b5-e4ec7f798fec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.190016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde67f0-84cd-4dd4-95b5-e4ec7f798fec admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=43dd173265f24c69af4b13b61722eb51) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.190329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde67f0-84cd-4dd4-95b5-e4ec7f798fec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.190953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48274576-43d3-4a04-8e13-b1dee3c2a900 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.191274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48274576-43d3-4a04-8e13-b1dee3c2a900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.191534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48274576-43d3-4a04-8e13-b1dee3c2a900 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.195483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde67f0-84cd-4dd4-95b5-e4ec7f798fec admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.202937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48274576-43d3-4a04-8e13-b1dee3c2a900 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.203654 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 318/628] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/role_assignments?user.id=43dd173265f24c69af4b13b61722eb51&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.204765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde67f0-84cd-4dd4-95b5-e4ec7f798fec admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.205752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48274576-43d3-4a04-8e13-b1dee3c2a900 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.215490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde67f0-84cd-4dd4-95b5-e4ec7f798fec admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.220436 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68970db-b483-4e47-a5a4-6457eb6b9e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.221706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68970db-b483-4e47-a5a4-6457eb6b9e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.222182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68970db-b483-4e47-a5a4-6457eb6b9e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.222980 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68970db-b483-4e47-a5a4-6457eb6b9e5e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.223082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-48274576-43d3-4a04-8e13-b1dee3c2a900 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 28 01:13:14.224380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 311/629] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:14.234349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48274576-43d3-4a04-8e13-b1dee3c2a900 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.235862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68970db-b483-4e47-a5a4-6457eb6b9e5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:14.243074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-a68970db-b483-4e47-a5a4-6457eb6b9e5e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:14.244974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 319/630] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:14.249472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48274576-43d3-4a04-8e13-b1dee3c2a900 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.251449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68970db-b483-4e47-a5a4-6457eb6b9e5e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.262061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c878e5-751d-4e4c-89fe-4d1b1d9d9ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.263199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c878e5-751d-4e4c-89fe-4d1b1d9d9ead admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.265061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c878e5-751d-4e4c-89fe-4d1b1d9d9ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.265602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c878e5-751d-4e4c-89fe-4d1b1d9d9ead admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.266797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c878e5-751d-4e4c-89fe-4d1b1d9d9ead admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.268626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c878e5-751d-4e4c-89fe-4d1b1d9d9ead admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.271041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c878e5-751d-4e4c-89fe-4d1b1d9d9ead admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.276059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68970db-b483-4e47-a5a4-6457eb6b9e5e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.286199 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ac342-fbb9-4682-ae56-08969b7d65e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.287222 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac342-fbb9-4682-ae56-08969b7d65e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.287685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac342-fbb9-4682-ae56-08969b7d65e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.288168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac342-fbb9-4682-ae56-08969b7d65e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.291051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ac342-fbb9-4682-ae56-08969b7d65e3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.291630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ac342-fbb9-4682-ae56-08969b7d65e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.293550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ac342-fbb9-4682-ae56-08969b7d65e3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.308348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 312/631] 10.222.0.16 () {56 vars in 1158 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.312231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 320/632] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.316595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c878e5-751d-4e4c-89fe-4d1b1d9d9ead admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.317958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ac342-fbb9-4682-ae56-08969b7d65e3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.327910 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ac342-fbb9-4682-ae56-08969b7d65e3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.331633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c878e5-751d-4e4c-89fe-4d1b1d9d9ead admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.333113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25042515-b6a6-412d-ab75-c72b52cf5fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.334212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042515-b6a6-412d-ab75-c72b52cf5fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.334677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042515-b6a6-412d-ab75-c72b52cf5fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.335218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042515-b6a6-412d-ab75-c72b52cf5fc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.347289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412be61a-010a-4146-8650-0905dc9ae5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.348659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412be61a-010a-4146-8650-0905dc9ae5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.349379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412be61a-010a-4146-8650-0905dc9ae5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.350047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412be61a-010a-4146-8650-0905dc9ae5e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.351072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25042515-b6a6-412d-ab75-c72b52cf5fc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.355189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25042515-b6a6-412d-ab75-c72b52cf5fc8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.369786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412be61a-010a-4146-8650-0905dc9ae5e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.373979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412be61a-010a-4146-8650-0905dc9ae5e2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.387649 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-25042515-b6a6-412d-ab75-c72b52cf5fc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:14.389660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 321/633] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:14.390074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 313/634] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:14.397613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25042515-b6a6-412d-ab75-c72b52cf5fc8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.401159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412be61a-010a-4146-8650-0905dc9ae5e2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.413973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25042515-b6a6-412d-ab75-c72b52cf5fc8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.414450 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412be61a-010a-4146-8650-0905dc9ae5e2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.418751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054d460-a4d6-49bc-b385-de976dcd1a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.419547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054d460-a4d6-49bc-b385-de976dcd1a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.419659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbe8b6-3cd0-4d98-93d8-65587c06d38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.419881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054d460-a4d6-49bc-b385-de976dcd1a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.420095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054d460-a4d6-49bc-b385-de976dcd1a0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.420286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbe8b6-3cd0-4d98-93d8-65587c06d38f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.420568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbe8b6-3cd0-4d98-93d8-65587c06d38f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.420838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbe8b6-3cd0-4d98-93d8-65587c06d38f admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.421710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbe8b6-3cd0-4d98-93d8-65587c06d38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.422008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbe8b6-3cd0-4d98-93d8-65587c06d38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.423594 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbe8b6-3cd0-4d98-93d8-65587c06d38f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.432873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054d460-a4d6-49bc-b385-de976dcd1a0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.434749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054d460-a4d6-49bc-b385-de976dcd1a0e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.437773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 314/635] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:14.441126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378604b-3ee4-4288-b4a6-5174d85c8c4b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.441126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378604b-3ee4-4288-b4a6-5174d85c8c4b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.441126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378604b-3ee4-4288-b4a6-5174d85c8c4b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.441126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 315/636] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:14.443559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378604b-3ee4-4288-b4a6-5174d85c8c4b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.459379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378604b-3ee4-4288-b4a6-5174d85c8c4b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.463164 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-b054d460-a4d6-49bc-b385-de976dcd1a0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:14.464982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 322/637] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:14.465213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0c8f6-f5c5-4bcc-abfe-fd1d326e1a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.466019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0c8f6-f5c5-4bcc-abfe-fd1d326e1a44 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.466293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0c8f6-f5c5-4bcc-abfe-fd1d326e1a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.466563 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0c8f6-f5c5-4bcc-abfe-fd1d326e1a44 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.466993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16628a1-8564-4f48-b7f1-248f302fdc4d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.467271 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16628a1-8564-4f48-b7f1-248f302fdc4d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.467543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16628a1-8564-4f48-b7f1-248f302fdc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.480298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0c8f6-f5c5-4bcc-abfe-fd1d326e1a44 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.482459 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0c8f6-f5c5-4bcc-abfe-fd1d326e1a44 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.487404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e16628a1-8564-4f48-b7f1-248f302fdc4d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:14.488651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e16628a1-8564-4f48-b7f1-248f302fdc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:14.496795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 323/638] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:14.497134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-06c0c8f6-f5c5-4bcc-abfe-fd1d326e1a44 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:13:14.497555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16628a1-8564-4f48-b7f1-248f302fdc4d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.498661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 316/639] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:14.507398 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0c8f6-f5c5-4bcc-abfe-fd1d326e1a44 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.513652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16628a1-8564-4f48-b7f1-248f302fdc4d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.518846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0c8f6-f5c5-4bcc-abfe-fd1d326e1a44 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.522841 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027ff90-f8c4-48f9-a8c7-730993a8dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.523354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b4d1d-7e86-44f7-9b70-989c7cf239de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.523904 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027ff90-f8c4-48f9-a8c7-730993a8dddc admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.524016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4d1d-7e86-44f7-9b70-989c7cf239de admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.524258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4d1d-7e86-44f7-9b70-989c7cf239de admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.524523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b4d1d-7e86-44f7-9b70-989c7cf239de admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.524745 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027ff90-f8c4-48f9-a8c7-730993a8dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.525183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027ff90-f8c4-48f9-a8c7-730993a8dddc admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.525405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b4d1d-7e86-44f7-9b70-989c7cf239de admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.525708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b4d1d-7e86-44f7-9b70-989c7cf239de admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.525954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027ff90-f8c4-48f9-a8c7-730993a8dddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.526263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027ff90-f8c4-48f9-a8c7-730993a8dddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.527602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b4d1d-7e86-44f7-9b70-989c7cf239de admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.527879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027ff90-f8c4-48f9-a8c7-730993a8dddc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.540154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 324/640] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.540990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027ff90-f8c4-48f9-a8c7-730993a8dddc admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.546937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 317/641] 10.222.0.16 () {56 vars in 1158 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.547830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b4d1d-7e86-44f7-9b70-989c7cf239de admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.550590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027ff90-f8c4-48f9-a8c7-730993a8dddc admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.555985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f279ded-7bec-488a-a93f-784c9301d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.556872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f279ded-7bec-488a-a93f-784c9301d927 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.557159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f279ded-7bec-488a-a93f-784c9301d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.557473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f279ded-7bec-488a-a93f-784c9301d927 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.564295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b4d1d-7e86-44f7-9b70-989c7cf239de admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.569515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f279ded-7bec-488a-a93f-784c9301d927 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:14.569771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1867ac-9744-4eee-b3ce-82e87845332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.570645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1867ac-9744-4eee-b3ce-82e87845332c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.570921 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1867ac-9744-4eee-b3ce-82e87845332c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.571190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1867ac-9744-4eee-b3ce-82e87845332c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.577141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-5f279ded-7bec-488a-a93f-784c9301d927 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:14.578541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 325/642] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:14.579174 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f279ded-7bec-488a-a93f-784c9301d927 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.579818 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1867ac-9744-4eee-b3ce-82e87845332c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.581895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1867ac-9744-4eee-b3ce-82e87845332c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.591552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f279ded-7bec-488a-a93f-784c9301d927 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.596018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-3a1867ac-9744-4eee-b3ce-82e87845332c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:14.596129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a24e0-31a7-4d49-9b19-64bc2443b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.596691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a24e0-31a7-4d49-9b19-64bc2443b7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.596971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a24e0-31a7-4d49-9b19-64bc2443b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.597250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a24e0-31a7-4d49-9b19-64bc2443b7e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.597372 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 318/643] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:14.598365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1867ac-9744-4eee-b3ce-82e87845332c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.607064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a24e0-31a7-4d49-9b19-64bc2443b7e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.608561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1867ac-9744-4eee-b3ce-82e87845332c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.608827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a24e0-31a7-4d49-9b19-64bc2443b7e7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.615938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5fd63-8076-4f7d-b28d-1dc723eda7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.616587 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5fd63-8076-4f7d-b28d-1dc723eda7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.616862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5fd63-8076-4f7d-b28d-1dc723eda7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.617130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5fd63-8076-4f7d-b28d-1dc723eda7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.617922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5fd63-8076-4f7d-b28d-1dc723eda7b6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.618216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5fd63-8076-4f7d-b28d-1dc723eda7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.618738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 326/644] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:14.619654 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a24e0-31a7-4d49-9b19-64bc2443b7e7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.619825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5fd63-8076-4f7d-b28d-1dc723eda7b6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.629320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a24e0-31a7-4d49-9b19-64bc2443b7e7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.634723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfef7-cdca-447c-bcb5-aaba9b3abdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.635519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfef7-cdca-447c-bcb5-aaba9b3abdae admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.635940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfef7-cdca-447c-bcb5-aaba9b3abdae admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.636215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfef7-cdca-447c-bcb5-aaba9b3abdae admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.637080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bfef7-cdca-447c-bcb5-aaba9b3abdae admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.637490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bfef7-cdca-447c-bcb5-aaba9b3abdae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.638122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 319/645] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.639104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5fd63-8076-4f7d-b28d-1dc723eda7b6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.639392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bfef7-cdca-447c-bcb5-aaba9b3abdae admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.648984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5fd63-8076-4f7d-b28d-1dc723eda7b6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.653980 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 327/646] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.654798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfef7-cdca-447c-bcb5-aaba9b3abdae admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.662749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c537e-d388-47de-85b4-063d54295a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.664201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c537e-d388-47de-85b4-063d54295a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.664484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c537e-d388-47de-85b4-063d54295a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.664764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c537e-d388-47de-85b4-063d54295a80 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.667139 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfef7-cdca-447c-bcb5-aaba9b3abdae admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.673168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03323-e498-4be2-9f27-344df4db75cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.674020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03323-e498-4be2-9f27-344df4db75cb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.674336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03323-e498-4be2-9f27-344df4db75cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.674607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03323-e498-4be2-9f27-344df4db75cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.677048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c537e-d388-47de-85b4-063d54295a80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.679234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c537e-d388-47de-85b4-063d54295a80 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.685730 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f03323-e498-4be2-9f27-344df4db75cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.687630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f03323-e498-4be2-9f27-344df4db75cb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.699563 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-5f2c537e-d388-47de-85b4-063d54295a80 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:14.701073 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 320/647] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:14.701891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c537e-d388-47de-85b4-063d54295a80 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.708384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-43f03323-e498-4be2-9f27-344df4db75cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:14.709958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 328/648] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:14.710834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03323-e498-4be2-9f27-344df4db75cb admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.711829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c537e-d388-47de-85b4-063d54295a80 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.716704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d6393-102a-4532-922c-8233918461fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.717954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d6393-102a-4532-922c-8233918461fe admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.718333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d6393-102a-4532-922c-8233918461fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.718576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d6393-102a-4532-922c-8233918461fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.719334 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d6393-102a-4532-922c-8233918461fe admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=36ec2950259d4ed0925d7a19a6217af2) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.719643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d6393-102a-4532-922c-8233918461fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.720637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03323-e498-4be2-9f27-344df4db75cb admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.721484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d6393-102a-4532-922c-8233918461fe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.725483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8f8c5-1948-4cf5-a302-999b66f1c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.726150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f8c5-1948-4cf5-a302-999b66f1c354 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.726479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f8c5-1948-4cf5-a302-999b66f1c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.726744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f8c5-1948-4cf5-a302-999b66f1c354 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.727515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f8c5-1948-4cf5-a302-999b66f1c354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.727905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f8c5-1948-4cf5-a302-999b66f1c354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.729612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f8c5-1948-4cf5-a302-999b66f1c354 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.731470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 321/649] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/role_assignments?user.id=36ec2950259d4ed0925d7a19a6217af2&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.737855 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d6393-102a-4532-922c-8233918461fe admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.756790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d6393-102a-4532-922c-8233918461fe admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.758425 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 329/650] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.763667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb8b15-01af-49e4-9c94-229998b7307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.764542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb8b15-01af-49e4-9c94-229998b7307c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.764820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb8b15-01af-49e4-9c94-229998b7307c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.765086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb8b15-01af-49e4-9c94-229998b7307c admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.766005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb8b15-01af-49e4-9c94-229998b7307c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.766316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb8b15-01af-49e4-9c94-229998b7307c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.768105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb8b15-01af-49e4-9c94-229998b7307c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.771480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8f8c5-1948-4cf5-a302-999b66f1c354 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.784258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8f8c5-1948-4cf5-a302-999b66f1c354 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.793860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99b2f8-80da-4540-9ba3-8af2f1a96f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.794708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99b2f8-80da-4540-9ba3-8af2f1a96f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.795035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99b2f8-80da-4540-9ba3-8af2f1a96f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.795339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99b2f8-80da-4540-9ba3-8af2f1a96f2b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.800527 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 322/651] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.806198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb8b15-01af-49e4-9c94-229998b7307c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.816645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99b2f8-80da-4540-9ba3-8af2f1a96f2b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.819880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99b2f8-80da-4540-9ba3-8af2f1a96f2b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.827989 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb8b15-01af-49e4-9c94-229998b7307c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.837011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a7cd-8b6d-4d37-a1d9-512605bb8921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.838974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a7cd-8b6d-4d37-a1d9-512605bb8921 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.839315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a7cd-8b6d-4d37-a1d9-512605bb8921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.839583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a7cd-8b6d-4d37-a1d9-512605bb8921 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.847955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-ef99b2f8-80da-4540-9ba3-8af2f1a96f2b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:14.852154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 330/652] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:14.856038 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4a7cd-8b6d-4d37-a1d9-512605bb8921 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.858880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99b2f8-80da-4540-9ba3-8af2f1a96f2b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.859903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4a7cd-8b6d-4d37-a1d9-512605bb8921 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.874919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99b2f8-80da-4540-9ba3-8af2f1a96f2b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.885668 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b4cdd-4a8a-4b7a-8813-eecf21197d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.886325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b4cdd-4a8a-4b7a-8813-eecf21197d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.886710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b4cdd-4a8a-4b7a-8813-eecf21197d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.886981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b4cdd-4a8a-4b7a-8813-eecf21197d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.887783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b4cdd-4a8a-4b7a-8813-eecf21197d66 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.888132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b4cdd-4a8a-4b7a-8813-eecf21197d66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.891903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b4cdd-4a8a-4b7a-8813-eecf21197d66 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.892481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-cdc4a7cd-8b6d-4d37-a1d9-512605bb8921 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:13:14.895398 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 323/653] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:14.901373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a7cd-8b6d-4d37-a1d9-512605bb8921 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.920968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a7cd-8b6d-4d37-a1d9-512605bb8921 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.921881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 331/654] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:14.925969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31cdca-0ba0-4f0a-88e6-0a474a0c8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.926718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31cdca-0ba0-4f0a-88e6-0a474a0c8bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.926991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31cdca-0ba0-4f0a-88e6-0a474a0c8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.927365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31cdca-0ba0-4f0a-88e6-0a474a0c8bfc admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.928860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b4cdd-4a8a-4b7a-8813-eecf21197d66 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.935958 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31cdca-0ba0-4f0a-88e6-0a474a0c8bfc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.936327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31cdca-0ba0-4f0a-88e6-0a474a0c8bfc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.939609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31cdca-0ba0-4f0a-88e6-0a474a0c8bfc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.943313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b4cdd-4a8a-4b7a-8813-eecf21197d66 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.955770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab27581-1df7-4be7-9161-947737b92dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.955770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27581-1df7-4be7-9161-947737b92dcf admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.955770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27581-1df7-4be7-9161-947737b92dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.956122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab27581-1df7-4be7-9161-947737b92dcf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:14.957007 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab27581-1df7-4be7-9161-947737b92dcf admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=a19c46c2ecd746d7a6e10c09d706a675) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:14.958959 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab27581-1df7-4be7-9161-947737b92dcf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:14.959805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab27581-1df7-4be7-9161-947737b92dcf admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:14.971154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 324/655] 10.222.0.16 () {56 vars in 1156 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:14.971508 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 332/656] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/role_assignments?user.id=a19c46c2ecd746d7a6e10c09d706a675&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:14.978671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab27581-1df7-4be7-9161-947737b92dcf admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:14.991087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab27581-1df7-4be7-9161-947737b92dcf admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:14.995746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c516d-4a5f-4328-a216-eb1f238ec0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:14.996660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c516d-4a5f-4328-a216-eb1f238ec0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:14.996938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c516d-4a5f-4328-a216-eb1f238ec0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:14.997206 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c516d-4a5f-4328-a216-eb1f238ec0f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.012383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c516d-4a5f-4328-a216-eb1f238ec0f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.014358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c516d-4a5f-4328-a216-eb1f238ec0f4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.032641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-e31c516d-4a5f-4328-a216-eb1f238ec0f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:15.034335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 333/657] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:15.040254 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31cdca-0ba0-4f0a-88e6-0a474a0c8bfc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.051377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31cdca-0ba0-4f0a-88e6-0a474a0c8bfc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.056632 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513edafb-d1b8-4543-92f8-2e36619090e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.057643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513edafb-d1b8-4543-92f8-2e36619090e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.058113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513edafb-d1b8-4543-92f8-2e36619090e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.058630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513edafb-d1b8-4543-92f8-2e36619090e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.059540 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513edafb-d1b8-4543-92f8-2e36619090e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:15.060053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513edafb-d1b8-4543-92f8-2e36619090e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.061937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513edafb-d1b8-4543-92f8-2e36619090e6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.079274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 325/658] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:15.086240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c516d-4a5f-4328-a216-eb1f238ec0f4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.098497 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c516d-4a5f-4328-a216-eb1f238ec0f4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.103527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599beb0-f417-4dcc-a340-5a22a0b3e736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.104594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599beb0-f417-4dcc-a340-5a22a0b3e736 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.105069 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599beb0-f417-4dcc-a340-5a22a0b3e736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.105737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599beb0-f417-4dcc-a340-5a22a0b3e736 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.113981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599beb0-f417-4dcc-a340-5a22a0b3e736 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.116389 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599beb0-f417-4dcc-a340-5a22a0b3e736 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.131519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-0599beb0-f417-4dcc-a340-5a22a0b3e736 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:15.133522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 334/659] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:15.139840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513edafb-d1b8-4543-92f8-2e36619090e6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.151055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513edafb-d1b8-4543-92f8-2e36619090e6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.156117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0223fca-cac0-48bc-a2f1-22e962f4f15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.156845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223fca-cac0-48bc-a2f1-22e962f4f15e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.157120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223fca-cac0-48bc-a2f1-22e962f4f15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.157465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223fca-cac0-48bc-a2f1-22e962f4f15e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.158267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0223fca-cac0-48bc-a2f1-22e962f4f15e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:15.158567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0223fca-cac0-48bc-a2f1-22e962f4f15e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.160514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0223fca-cac0-48bc-a2f1-22e962f4f15e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.174917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 326/660] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:15.180732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599beb0-f417-4dcc-a340-5a22a0b3e736 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.192028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599beb0-f417-4dcc-a340-5a22a0b3e736 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.196555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2ef8-ff14-451e-84b8-171d645be97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.197512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2ef8-ff14-451e-84b8-171d645be97c admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.197874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2ef8-ff14-451e-84b8-171d645be97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.198178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2ef8-ff14-451e-84b8-171d645be97c admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/ca65456d336b4c3898831af80e6435a6/roles/13ec9c0076334780847c0f750f4af8f4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.213825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff2ef8-ff14-451e-84b8-171d645be97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=ca65456d336b4c3898831af80e6435a6, role_id=13ec9c0076334780847c0f750f4af8f4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.217452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e1f3d-baaa-45ad-b923-569225f25baf None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.217596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff2ef8-ff14-451e-84b8-171d645be97c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.217741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e1f3d-baaa-45ad-b923-569225f25baf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.217998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e1f3d-baaa-45ad-b923-569225f25baf None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.220043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 327/661] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:15.226311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0946f92-8f26-45b8-bdfb-58b5a8df24a7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.226617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0946f92-8f26-45b8-bdfb-58b5a8df24a7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.226936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0946f92-8f26-45b8-bdfb-58b5a8df24a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.240003 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 335/662] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:15 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/ca65456d336b4c3898831af80e6435a6/roles/13ec9c0076334780847c0f750f4af8f4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:15.250276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a0946f92-8f26-45b8-bdfb-58b5a8df24a7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:15.250804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a0946f92-8f26-45b8-bdfb-58b5a8df24a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:15.318645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 328/663] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:15.344237 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2ef8-ff14-451e-84b8-171d645be97c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.355340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2ef8-ff14-451e-84b8-171d645be97c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.360224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b23db-50ad-4ae7-8b61-6cfaf0e5f612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.361027 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b23db-50ad-4ae7-8b61-6cfaf0e5f612 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.361377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b23db-50ad-4ae7-8b61-6cfaf0e5f612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.361643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b23db-50ad-4ae7-8b61-6cfaf0e5f612 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.373692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b23db-50ad-4ae7-8b61-6cfaf0e5f612 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:15.380961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-a83b23db-50ad-4ae7-8b61-6cfaf0e5f612 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:15.382529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 336/664] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:15.388467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0946f92-8f26-45b8-bdfb-58b5a8df24a7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.400013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0946f92-8f26-45b8-bdfb-58b5a8df24a7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.407443 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b747277-12cc-442a-91b4-02f57ed205f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.408401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747277-12cc-442a-91b4-02f57ed205f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.408843 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747277-12cc-442a-91b4-02f57ed205f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.409383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b747277-12cc-442a-91b4-02f57ed205f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.410340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b747277-12cc-442a-91b4-02f57ed205f1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:15.410878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b747277-12cc-442a-91b4-02f57ed205f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.412633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b747277-12cc-442a-91b4-02f57ed205f1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.423412 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 329/665] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:15.429020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b23db-50ad-4ae7-8b61-6cfaf0e5f612 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.439829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b23db-50ad-4ae7-8b61-6cfaf0e5f612 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.444923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935a5d2-9e87-4e84-b85f-7c784fae6257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.445804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935a5d2-9e87-4e84-b85f-7c784fae6257 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.446151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935a5d2-9e87-4e84-b85f-7c784fae6257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.446487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935a5d2-9e87-4e84-b85f-7c784fae6257 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.458528 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935a5d2-9e87-4e84-b85f-7c784fae6257 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.460428 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935a5d2-9e87-4e84-b85f-7c784fae6257 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.479485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-9935a5d2-9e87-4e84-b85f-7c784fae6257 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:15.481029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 337/666] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:15.486283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b747277-12cc-442a-91b4-02f57ed205f1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.496389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b747277-12cc-442a-91b4-02f57ed205f1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.501131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77366795-aedc-48e5-b203-9c4858b071c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.501832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366795-aedc-48e5-b203-9c4858b071c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.502156 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366795-aedc-48e5-b203-9c4858b071c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.502435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366795-aedc-48e5-b203-9c4858b071c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.503356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77366795-aedc-48e5-b203-9c4858b071c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:15.503663 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77366795-aedc-48e5-b203-9c4858b071c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.505428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77366795-aedc-48e5-b203-9c4858b071c8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.519431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 330/667] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:15.524986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935a5d2-9e87-4e84-b85f-7c784fae6257 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.535295 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935a5d2-9e87-4e84-b85f-7c784fae6257 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.540223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbb330-a1dd-44ba-b8e3-a8dfe3bfbece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.541202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbb330-a1dd-44ba-b8e3-a8dfe3bfbece admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.541712 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbb330-a1dd-44ba-b8e3-a8dfe3bfbece admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.542174 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbb330-a1dd-44ba-b8e3-a8dfe3bfbece admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.551143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbb330-a1dd-44ba-b8e3-a8dfe3bfbece admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.553467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbb330-a1dd-44ba-b8e3-a8dfe3bfbece admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.567775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-21fbb330-a1dd-44ba-b8e3-a8dfe3bfbece admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 28 01:13:15.569491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 338/668] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:15.578475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77366795-aedc-48e5-b203-9c4858b071c8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.592775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77366795-aedc-48e5-b203-9c4858b071c8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.598078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98c9f0-d415-4519-8cce-e457e15818e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.598979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98c9f0-d415-4519-8cce-e457e15818e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.599421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98c9f0-d415-4519-8cce-e457e15818e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.600001 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98c9f0-d415-4519-8cce-e457e15818e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.601068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98c9f0-d415-4519-8cce-e457e15818e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:15.601579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98c9f0-d415-4519-8cce-e457e15818e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.603808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98c9f0-d415-4519-8cce-e457e15818e2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.624856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 331/669] 10.222.0.16 () {56 vars in 1160 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:15.630632 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbb330-a1dd-44ba-b8e3-a8dfe3bfbece admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.641380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbb330-a1dd-44ba-b8e3-a8dfe3bfbece admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.646165 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119f53-f1d0-40f2-8092-41c7d185cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.647025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119f53-f1d0-40f2-8092-41c7d185cf08 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.647536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119f53-f1d0-40f2-8092-41c7d185cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.647971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119f53-f1d0-40f2-8092-41c7d185cf08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.656607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c119f53-f1d0-40f2-8092-41c7d185cf08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.658664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c119f53-f1d0-40f2-8092-41c7d185cf08 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.667983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 339/670] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:15.673444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98c9f0-d415-4519-8cce-e457e15818e2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.684426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98c9f0-d415-4519-8cce-e457e15818e2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.689324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c707f-d660-480e-a13a-0613272a4e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.690288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c707f-d660-480e-a13a-0613272a4e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.690729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c707f-d660-480e-a13a-0613272a4e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.691183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c707f-d660-480e-a13a-0613272a4e24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.702246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c707f-d660-480e-a13a-0613272a4e24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.704249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c707f-d660-480e-a13a-0613272a4e24 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.721380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-7d0c707f-d660-480e-a13a-0613272a4e24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:15.723414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 332/671] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:15.729757 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119f53-f1d0-40f2-8092-41c7d185cf08 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.741511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119f53-f1d0-40f2-8092-41c7d185cf08 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.746828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c42a4a-6c67-4e86-941d-2cfd033f2005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.747813 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c42a4a-6c67-4e86-941d-2cfd033f2005 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.748262 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c42a4a-6c67-4e86-941d-2cfd033f2005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.748768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c42a4a-6c67-4e86-941d-2cfd033f2005 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.749802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c42a4a-6c67-4e86-941d-2cfd033f2005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:15.750316 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c42a4a-6c67-4e86-941d-2cfd033f2005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.752160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c42a4a-6c67-4e86-941d-2cfd033f2005 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.768794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 340/672] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:15.774759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c707f-d660-480e-a13a-0613272a4e24 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.785213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c707f-d660-480e-a13a-0613272a4e24 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.790087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729e2c2-0510-410d-abc9-512a6e3aa22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.791115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729e2c2-0510-410d-abc9-512a6e3aa22a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.791580 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729e2c2-0510-410d-abc9-512a6e3aa22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.792063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729e2c2-0510-410d-abc9-512a6e3aa22a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.799927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729e2c2-0510-410d-abc9-512a6e3aa22a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.802178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729e2c2-0510-410d-abc9-512a6e3aa22a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.815233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-8729e2c2-0510-410d-abc9-512a6e3aa22a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:15.817081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 333/673] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:15.822590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c42a4a-6c67-4e86-941d-2cfd033f2005 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.838188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c42a4a-6c67-4e86-941d-2cfd033f2005 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.843704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148ec46-9ac7-4db3-aef7-d36f9067cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.844650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148ec46-9ac7-4db3-aef7-d36f9067cefa admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.845126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148ec46-9ac7-4db3-aef7-d36f9067cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.845642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148ec46-9ac7-4db3-aef7-d36f9067cefa admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.846679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148ec46-9ac7-4db3-aef7-d36f9067cefa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:15.847146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148ec46-9ac7-4db3-aef7-d36f9067cefa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.849633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148ec46-9ac7-4db3-aef7-d36f9067cefa admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.868508 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 341/674] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:15.874059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729e2c2-0510-410d-abc9-512a6e3aa22a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:15.885171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729e2c2-0510-410d-abc9-512a6e3aa22a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:15.893433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded0de4-f3eb-4f97-83a1-efac8be1caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:15.894330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded0de4-f3eb-4f97-83a1-efac8be1caeb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:15.894785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded0de4-f3eb-4f97-83a1-efac8be1caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:15.895242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded0de4-f3eb-4f97-83a1-efac8be1caeb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:15.896278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded0de4-f3eb-4f97-83a1-efac8be1caeb admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=84470027e2824dc3a4b735d086de1300) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:15.896781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded0de4-f3eb-4f97-83a1-efac8be1caeb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:15.898899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded0de4-f3eb-4f97-83a1-efac8be1caeb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:15.905722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 334/675] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:15 2022] GET /identity/v3/role_assignments?user.id=84470027e2824dc3a4b735d086de1300&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:16.950917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b51957-6b98-415b-b5b3-3bb747ce11ed None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:16.951939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b51957-6b98-415b-b5b3-3bb747ce11ed None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:16.952409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b51957-6b98-415b-b5b3-3bb747ce11ed None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:16.954668 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 342/676] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:16.960385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ce3ed-6e92-4d10-ac69-a15d51b35310 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:16.961206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ce3ed-6e92-4d10-ac69-a15d51b35310 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:16.961690 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ce3ed-6e92-4d10-ac69-a15d51b35310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:16.985361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-085ce3ed-6e92-4d10-ac69-a15d51b35310 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:16.986822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-085ce3ed-6e92-4d10-ac69-a15d51b35310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:16.999766 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 335/677] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:17.036669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b51957-6b98-415b-b5b3-3bb747ce11ed None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.057845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b51957-6b98-415b-b5b3-3bb747ce11ed None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.062783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb1eb-d6c1-47a5-ac23-8abbe9a77501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.063816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb1eb-d6c1-47a5-ac23-8abbe9a77501 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.064306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb1eb-d6c1-47a5-ac23-8abbe9a77501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.064763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb1eb-d6c1-47a5-ac23-8abbe9a77501 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.081599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcb1eb-d6c1-47a5-ac23-8abbe9a77501 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:17.088727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-73dcb1eb-d6c1-47a5-ac23-8abbe9a77501 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:13:17.090643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 343/678] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:17.096610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ce3ed-6e92-4d10-ac69-a15d51b35310 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.110413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ce3ed-6e92-4d10-ac69-a15d51b35310 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.121399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2018d1-9292-491c-90f4-cb0f26e72a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.122072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2018d1-9292-491c-90f4-cb0f26e72a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.122345 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2018d1-9292-491c-90f4-cb0f26e72a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.122609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2018d1-9292-491c-90f4-cb0f26e72a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.123384 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2018d1-9292-491c-90f4-cb0f26e72a03 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:17.123679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2018d1-9292-491c-90f4-cb0f26e72a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.125278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2018d1-9292-491c-90f4-cb0f26e72a03 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.140721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 336/679] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:17.146216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb1eb-d6c1-47a5-ac23-8abbe9a77501 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.159140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb1eb-d6c1-47a5-ac23-8abbe9a77501 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.167309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc9b9-9065-4a89-b520-8affcd9aa79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.168392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc9b9-9065-4a89-b520-8affcd9aa79c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.168860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc9b9-9065-4a89-b520-8affcd9aa79c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.169373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bc9b9-9065-4a89-b520-8affcd9aa79c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.185335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bc9b9-9065-4a89-b520-8affcd9aa79c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.187541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bc9b9-9065-4a89-b520-8affcd9aa79c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.212543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-ac8bc9b9-9065-4a89-b520-8affcd9aa79c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:17.214347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 344/680] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:17.220125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2018d1-9292-491c-90f4-cb0f26e72a03 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.238329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2018d1-9292-491c-90f4-cb0f26e72a03 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.250479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409038f2-5c21-46d6-bcad-88f5074d9213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.251142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409038f2-5c21-46d6-bcad-88f5074d9213 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.251423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409038f2-5c21-46d6-bcad-88f5074d9213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.251693 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409038f2-5c21-46d6-bcad-88f5074d9213 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.252436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409038f2-5c21-46d6-bcad-88f5074d9213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:17.252734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409038f2-5c21-46d6-bcad-88f5074d9213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.254349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409038f2-5c21-46d6-bcad-88f5074d9213 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.274963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 337/681] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:17.280672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc9b9-9065-4a89-b520-8affcd9aa79c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.294690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bc9b9-9065-4a89-b520-8affcd9aa79c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.302141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c37c66-a540-4b84-a5c9-681c4f4a299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.303193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c37c66-a540-4b84-a5c9-681c4f4a299e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.303697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c37c66-a540-4b84-a5c9-681c4f4a299e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.304182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c37c66-a540-4b84-a5c9-681c4f4a299e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.319988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c37c66-a540-4b84-a5c9-681c4f4a299e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.322357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c37c66-a540-4b84-a5c9-681c4f4a299e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.340223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-60c37c66-a540-4b84-a5c9-681c4f4a299e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:13:17.342288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 345/682] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:17.348884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409038f2-5c21-46d6-bcad-88f5074d9213 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.366588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409038f2-5c21-46d6-bcad-88f5074d9213 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.378637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2091179-06ca-48dd-bde1-c77b1312d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.379327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2091179-06ca-48dd-bde1-c77b1312d62a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.379609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2091179-06ca-48dd-bde1-c77b1312d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.379884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2091179-06ca-48dd-bde1-c77b1312d62a admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.380751 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2091179-06ca-48dd-bde1-c77b1312d62a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:17.381050 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2091179-06ca-48dd-bde1-c77b1312d62a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.382959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2091179-06ca-48dd-bde1-c77b1312d62a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.417305 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 338/683] 10.222.0.16 () {56 vars in 1154 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:17.423131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c37c66-a540-4b84-a5c9-681c4f4a299e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.438797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c37c66-a540-4b84-a5c9-681c4f4a299e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.447718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45af48-f184-4af2-b582-9cb4fd15d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.448376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45af48-f184-4af2-b582-9cb4fd15d229 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.448648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45af48-f184-4af2-b582-9cb4fd15d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.448916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45af48-f184-4af2-b582-9cb4fd15d229 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.465071 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45af48-f184-4af2-b582-9cb4fd15d229 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.466799 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45af48-f184-4af2-b582-9cb4fd15d229 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.478427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 346/684] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:17.484306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2091179-06ca-48dd-bde1-c77b1312d62a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.498492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2091179-06ca-48dd-bde1-c77b1312d62a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.509488 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289062-70ce-42a5-a986-773ce319a34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.510283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289062-70ce-42a5-a986-773ce319a34b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.510556 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289062-70ce-42a5-a986-773ce319a34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.510822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2289062-70ce-42a5-a986-773ce319a34b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.533174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2289062-70ce-42a5-a986-773ce319a34b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.535059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2289062-70ce-42a5-a986-773ce319a34b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.564513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a2289062-70ce-42a5-a986-773ce319a34b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:17.566186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 339/685] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:17.571774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45af48-f184-4af2-b582-9cb4fd15d229 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.586388 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45af48-f184-4af2-b582-9cb4fd15d229 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.602394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3690f64-a4bf-4529-8cf7-80124e19ba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.603067 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3690f64-a4bf-4529-8cf7-80124e19ba4c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.603343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3690f64-a4bf-4529-8cf7-80124e19ba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.603607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3690f64-a4bf-4529-8cf7-80124e19ba4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.604346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3690f64-a4bf-4529-8cf7-80124e19ba4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:17.604644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3690f64-a4bf-4529-8cf7-80124e19ba4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.606413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3690f64-a4bf-4529-8cf7-80124e19ba4c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.635982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 347/686] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:17.641654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289062-70ce-42a5-a986-773ce319a34b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.654512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2289062-70ce-42a5-a986-773ce319a34b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.665400 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b2d23-b7e4-495b-9fc3-13ce1ed9be91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.666228 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2d23-b7e4-495b-9fc3-13ce1ed9be91 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.666508 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2d23-b7e4-495b-9fc3-13ce1ed9be91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.666782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b2d23-b7e4-495b-9fc3-13ce1ed9be91 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.686865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b2d23-b7e4-495b-9fc3-13ce1ed9be91 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.688938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b2d23-b7e4-495b-9fc3-13ce1ed9be91 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.713281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-607b2d23-b7e4-495b-9fc3-13ce1ed9be91 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:17.715011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 340/687] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:17.720873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3690f64-a4bf-4529-8cf7-80124e19ba4c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.734412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3690f64-a4bf-4529-8cf7-80124e19ba4c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.738968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bd8ae-3066-4c36-be4a-1452521d11a8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.739252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bd8ae-3066-4c36-be4a-1452521d11a8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.739524 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bd8ae-3066-4c36-be4a-1452521d11a8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.741506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 341/688] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:17.746025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a9974-8bde-4718-bf23-c4733c345101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.746753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a9974-8bde-4718-bf23-c4733c345101 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.747031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a9974-8bde-4718-bf23-c4733c345101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.747304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a9974-8bde-4718-bf23-c4733c345101 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.748111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a9974-8bde-4718-bf23-c4733c345101 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:17.748414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a9974-8bde-4718-bf23-c4733c345101 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.750302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a9974-8bde-4718-bf23-c4733c345101 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.755321 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7be5d-0dd7-4238-b777-948f3b2a6910 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.755600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7be5d-0dd7-4238-b777-948f3b2a6910 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.755871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7be5d-0dd7-4238-b777-948f3b2a6910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.770457 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 348/689] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:17.774894 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a9974-8bde-4718-bf23-c4733c345101 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.787255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-eda7be5d-0dd7-4238-b777-948f3b2a6910 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:17.788445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-eda7be5d-0dd7-4238-b777-948f3b2a6910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:17.793729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a9974-8bde-4718-bf23-c4733c345101 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.803310 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3f2b5-4ef6-4c3d-bfae-de8f199bbc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.803974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3f2b5-4ef6-4c3d-bfae-de8f199bbc4a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.804253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3f2b5-4ef6-4c3d-bfae-de8f199bbc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.804529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3f2b5-4ef6-4c3d-bfae-de8f199bbc4a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.809554 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 342/690] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:13:17.809792 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3f2b5-4ef6-4c3d-bfae-de8f199bbc4a admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=43dd173265f24c69af4b13b61722eb51) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:17.810127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3f2b5-4ef6-4c3d-bfae-de8f199bbc4a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.811994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3f2b5-4ef6-4c3d-bfae-de8f199bbc4a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.821707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 349/691] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/role_assignments?user.id=43dd173265f24c69af4b13b61722eb51&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:17.826533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fd0b7-31de-4678-b357-241ea9b32d02 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.826822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fd0b7-31de-4678-b357-241ea9b32d02 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.827102 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fd0b7-31de-4678-b357-241ea9b32d02 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.829197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 343/692] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:17.842240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14397c-cc46-4ebb-a8f6-15d0a829f199 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.842517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14397c-cc46-4ebb-a8f6-15d0a829f199 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.842789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14397c-cc46-4ebb-a8f6-15d0a829f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.846277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fd0b7-31de-4678-b357-241ea9b32d02 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.870009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fd0b7-31de-4678-b357-241ea9b32d02 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.878945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-fd14397c-cc46-4ebb-a8f6-15d0a829f199 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:17.879771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5a1fb-d60b-4684-b40d-72b0b41870a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.880152 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-fd14397c-cc46-4ebb-a8f6-15d0a829f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:17.880668 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a1fb-d60b-4684-b40d-72b0b41870a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.880959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a1fb-d60b-4684-b40d-72b0b41870a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.881268 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a1fb-d60b-4684-b40d-72b0b41870a6 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.882074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5a1fb-d60b-4684-b40d-72b0b41870a6 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.883097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-15f5a1fb-d60b-4684-b40d-72b0b41870a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:17.883097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:13:17.883097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:13:17.883996 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5a1fb-d60b-4684-b40d-72b0b41870a6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.899304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 350/693] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:17.905626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-15f5a1fb-d60b-4684-b40d-72b0b41870a6 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:13:17.907271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 344/694] 10.222.0.16 () {56 vars in 1150 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:17.913059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14397c-cc46-4ebb-a8f6-15d0a829f199 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.925903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5a1fb-d60b-4684-b40d-72b0b41870a6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.929063 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14397c-cc46-4ebb-a8f6-15d0a829f199 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.938970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0d8c4-0fea-4f6f-aa82-0451dce31558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.939954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d8c4-0fea-4f6f-aa82-0451dce31558 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.940277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d8c4-0fea-4f6f-aa82-0451dce31558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.941786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0d8c4-0fea-4f6f-aa82-0451dce31558 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.943551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0d8c4-0fea-4f6f-aa82-0451dce31558 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:17.943854 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0d8c4-0fea-4f6f-aa82-0451dce31558 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.944961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-48d0d8c4-0fea-4f6f-aa82-0451dce31558 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:17.944961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:13:17.944961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:13:17.947688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0d8c4-0fea-4f6f-aa82-0451dce31558 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:17.949034 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5a1fb-d60b-4684-b40d-72b0b41870a6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.957095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c09af-1b9c-49db-9960-cadcf9719b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.957963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c09af-1b9c-49db-9960-cadcf9719b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.958234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c09af-1b9c-49db-9960-cadcf9719b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.958499 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c09af-1b9c-49db-9960-cadcf9719b8c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.960177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 351/695] 10.222.0.16 () {56 vars in 1145 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:17.961719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11306e-9404-4737-be99-0b941b9fe6c4 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.961986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11306e-9404-4737-be99-0b941b9fe6c4 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.962249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11306e-9404-4737-be99-0b941b9fe6c4 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.964146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 352/696] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:17.969485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11306e-9404-4737-be99-0b941b9fe6c4 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:17.975166 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c09af-1b9c-49db-9960-cadcf9719b8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:17.982181 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11306e-9404-4737-be99-0b941b9fe6c4 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:17.983197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-205c09af-1b9c-49db-9960-cadcf9719b8c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:17.984775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 345/697] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:17.986074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471892e-a2b6-4160-9556-1e51dfc6e207 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.986340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471892e-a2b6-4160-9556-1e51dfc6e207 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.986610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471892e-a2b6-4160-9556-1e51dfc6e207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.987993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea177-5509-4b14-b85e-f400928a0860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:17.989157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea177-5509-4b14-b85e-f400928a0860 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:17.989737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea177-5509-4b14-b85e-f400928a0860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:17.990282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea177-5509-4b14-b85e-f400928a0860 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:17.991441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bea177-5509-4b14-b85e-f400928a0860 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:17.991975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bea177-5509-4b14-b85e-f400928a0860 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:17.993963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bea177-5509-4b14-b85e-f400928a0860 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.000875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 353/698] 10.222.0.16 () {56 vars in 1145 bytes} [Fri Jan 28 01:13:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:18.001931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea177-5509-4b14-b85e-f400928a0860 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.007149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0471892e-a2b6-4160-9556-1e51dfc6e207 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:18.008734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0471892e-a2b6-4160-9556-1e51dfc6e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:18.013510 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea177-5509-4b14-b85e-f400928a0860 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.017335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 346/699] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:18.029284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e07df-4ddf-4cbe-ba26-2dfe9f606bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.029284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e07df-4ddf-4cbe-ba26-2dfe9f606bbc admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.029284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e07df-4ddf-4cbe-ba26-2dfe9f606bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.029284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e07df-4ddf-4cbe-ba26-2dfe9f606bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.029759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e07df-4ddf-4cbe-ba26-2dfe9f606bbc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:18.029759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e07df-4ddf-4cbe-ba26-2dfe9f606bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.029759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e07df-4ddf-4cbe-ba26-2dfe9f606bbc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.048774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 354/700] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:18.054648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471892e-a2b6-4160-9556-1e51dfc6e207 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.059506 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e07df-4ddf-4cbe-ba26-2dfe9f606bbc admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.065625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471892e-a2b6-4160-9556-1e51dfc6e207 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.070396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e07df-4ddf-4cbe-ba26-2dfe9f606bbc admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.070867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017c75-16b0-4959-9bec-9a686e7d3e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.071987 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017c75-16b0-4959-9bec-9a686e7d3e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.072517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017c75-16b0-4959-9bec-9a686e7d3e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.072988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017c75-16b0-4959-9bec-9a686e7d3e66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.077133 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df0733-7cf5-4b9d-bf9c-eb5d888c27f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.077763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df0733-7cf5-4b9d-bf9c-eb5d888c27f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.078042 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df0733-7cf5-4b9d-bf9c-eb5d888c27f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.078317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df0733-7cf5-4b9d-bf9c-eb5d888c27f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.088125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70017c75-16b0-4959-9bec-9a686e7d3e66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.090743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70017c75-16b0-4959-9bec-9a686e7d3e66 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.091510 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df0733-7cf5-4b9d-bf9c-eb5d888c27f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.094234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df0733-7cf5-4b9d-bf9c-eb5d888c27f1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.113536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-e5df0733-7cf5-4b9d-bf9c-eb5d888c27f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:18.113761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-70017c75-16b0-4959-9bec-9a686e7d3e66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:18.115288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 347/701] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:18.115680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 355/702] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:18.120902 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017c75-16b0-4959-9bec-9a686e7d3e66 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.122201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df0733-7cf5-4b9d-bf9c-eb5d888c27f1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.135485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df0733-7cf5-4b9d-bf9c-eb5d888c27f1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.136869 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017c75-16b0-4959-9bec-9a686e7d3e66 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.141188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870f2e1-af8a-4933-b4aa-c6277b6f175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.141830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283027c-bee4-4a1d-924d-21ed2b453bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.142405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870f2e1-af8a-4933-b4aa-c6277b6f175d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.142822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283027c-bee4-4a1d-924d-21ed2b453bea admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.142995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870f2e1-af8a-4933-b4aa-c6277b6f175d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.143279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283027c-bee4-4a1d-924d-21ed2b453bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.143555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870f2e1-af8a-4933-b4aa-c6277b6f175d admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.143760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283027c-bee4-4a1d-924d-21ed2b453bea admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.144635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283027c-bee4-4a1d-924d-21ed2b453bea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:18.144749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870f2e1-af8a-4933-b4aa-c6277b6f175d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:18.145132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283027c-bee4-4a1d-924d-21ed2b453bea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.145328 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870f2e1-af8a-4933-b4aa-c6277b6f175d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.147014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283027c-bee4-4a1d-924d-21ed2b453bea admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.147205 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870f2e1-af8a-4933-b4aa-c6277b6f175d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.160255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 348/703] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:18.163989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 356/704] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:18.168777 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283027c-bee4-4a1d-924d-21ed2b453bea admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.170121 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870f2e1-af8a-4933-b4aa-c6277b6f175d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.181196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870f2e1-af8a-4933-b4aa-c6277b6f175d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.184386 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283027c-bee4-4a1d-924d-21ed2b453bea admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.186765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49baa-c147-437c-bc41-7a0607f34387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.187825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49baa-c147-437c-bc41-7a0607f34387 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.188270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49baa-c147-437c-bc41-7a0607f34387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.188772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49baa-c147-437c-bc41-7a0607f34387 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.189859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49baa-c147-437c-bc41-7a0607f34387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.192127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad49baa-c147-437c-bc41-7a0607f34387 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.194731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d860-5b6e-4886-9f72-6be7c6af8cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.195742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d860-5b6e-4886-9f72-6be7c6af8cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.196104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d860-5b6e-4886-9f72-6be7c6af8cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.196465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450d860-5b6e-4886-9f72-6be7c6af8cb2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.211749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450d860-5b6e-4886-9f72-6be7c6af8cb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.214264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450d860-5b6e-4886-9f72-6be7c6af8cb2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.223333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 357/705] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:13:18 2022] POST /identity/v3/users => generated 254 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:18.236967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9450d860-5b6e-4886-9f72-6be7c6af8cb2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:13:18.238551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 349/706] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:18.244573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49baa-c147-437c-bc41-7a0607f34387 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.255431 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad49baa-c147-437c-bc41-7a0607f34387 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.260567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae239ad-bfdb-4401-8556-fafd3766b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.261487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae239ad-bfdb-4401-8556-fafd3766b716 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.261902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae239ad-bfdb-4401-8556-fafd3766b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.262236 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae239ad-bfdb-4401-8556-fafd3766b716 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.263215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae239ad-bfdb-4401-8556-fafd3766b716 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:18.263576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae239ad-bfdb-4401-8556-fafd3766b716 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.265696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae239ad-bfdb-4401-8556-fafd3766b716 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.287639 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 358/707] 10.222.0.16 () {56 vars in 1156 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:18.293673 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d860-5b6e-4886-9f72-6be7c6af8cb2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.307729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450d860-5b6e-4886-9f72-6be7c6af8cb2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.322153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d83c8e-cbe2-45cd-89ca-77417f412c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.322837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d83c8e-cbe2-45cd-89ca-77417f412c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.323118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d83c8e-cbe2-45cd-89ca-77417f412c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.323387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d83c8e-cbe2-45cd-89ca-77417f412c24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.332885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d83c8e-cbe2-45cd-89ca-77417f412c24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.334706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d83c8e-cbe2-45cd-89ca-77417f412c24 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.350182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 350/708] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:13:18.356194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae239ad-bfdb-4401-8556-fafd3766b716 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.374951 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae239ad-bfdb-4401-8556-fafd3766b716 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.384672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7015ba1-5a02-4108-9583-0acfc37bb754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.385601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7015ba1-5a02-4108-9583-0acfc37bb754 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.385874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7015ba1-5a02-4108-9583-0acfc37bb754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.386140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7015ba1-5a02-4108-9583-0acfc37bb754 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.401849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7015ba1-5a02-4108-9583-0acfc37bb754 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.403871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7015ba1-5a02-4108-9583-0acfc37bb754 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.424486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-c7015ba1-5a02-4108-9583-0acfc37bb754 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:18.425936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 359/709] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:18.431424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d83c8e-cbe2-45cd-89ca-77417f412c24 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.445433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d83c8e-cbe2-45cd-89ca-77417f412c24 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.451639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e83c-77ce-4e5e-9f1f-080c22c4dbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.452311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e83c-77ce-4e5e-9f1f-080c22c4dbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.452593 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e83c-77ce-4e5e-9f1f-080c22c4dbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.452864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5e83c-77ce-4e5e-9f1f-080c22c4dbc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.453654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e83c-77ce-4e5e-9f1f-080c22c4dbc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:18.453953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e83c-77ce-4e5e-9f1f-080c22c4dbc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.455547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5e83c-77ce-4e5e-9f1f-080c22c4dbc6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.469692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 351/710] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:18.475289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7015ba1-5a02-4108-9583-0acfc37bb754 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.493468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7015ba1-5a02-4108-9583-0acfc37bb754 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.502155 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7deb8b0-5b79-42aa-8132-a301a3bf36ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.503335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7deb8b0-5b79-42aa-8132-a301a3bf36ae admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.503806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7deb8b0-5b79-42aa-8132-a301a3bf36ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.504266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7deb8b0-5b79-42aa-8132-a301a3bf36ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.517255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7deb8b0-5b79-42aa-8132-a301a3bf36ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.517255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7deb8b0-5b79-42aa-8132-a301a3bf36ae admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.533340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-a7deb8b0-5b79-42aa-8132-a301a3bf36ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:18.534928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 360/711] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:18.540853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e83c-77ce-4e5e-9f1f-080c22c4dbc6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.557267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5e83c-77ce-4e5e-9f1f-080c22c4dbc6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.562269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a0ca7-4bf5-4b19-9410-c7bd3253f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.562924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a0ca7-4bf5-4b19-9410-c7bd3253f0ee admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.563197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a0ca7-4bf5-4b19-9410-c7bd3253f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.563464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a0ca7-4bf5-4b19-9410-c7bd3253f0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.564262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a0ca7-4bf5-4b19-9410-c7bd3253f0ee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:18.564561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a0ca7-4bf5-4b19-9410-c7bd3253f0ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.566585 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a0ca7-4bf5-4b19-9410-c7bd3253f0ee admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.580092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 352/712] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:18.586098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7deb8b0-5b79-42aa-8132-a301a3bf36ae admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:18.596512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7deb8b0-5b79-42aa-8132-a301a3bf36ae admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:18.601341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbc5aa-dbea-4685-9633-c4aa393c96b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:18.602041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbc5aa-dbea-4685-9633-c4aa393c96b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:18.602312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbc5aa-dbea-4685-9633-c4aa393c96b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:18.602577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbc5aa-dbea-4685-9633-c4aa393c96b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:18.603422 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbc5aa-dbea-4685-9633-c4aa393c96b3 admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=ca65456d336b4c3898831af80e6435a6) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:18.603706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbc5aa-dbea-4685-9633-c4aa393c96b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:18.605718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbc5aa-dbea-4685-9633-c4aa393c96b3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:18.619636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 361/713] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:18 2022] GET /identity/v3/role_assignments?user.id=ca65456d336b4c3898831af80e6435a6&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:19.190688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1a601-2d8a-41a3-bfc0-f7e8eda97043 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:19.191242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1a601-2d8a-41a3-bfc0-f7e8eda97043 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:19.191242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1a601-2d8a-41a3-bfc0-f7e8eda97043 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:19.193322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 353/714] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:19.199227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6532b-76b7-4238-bd6d-a76a91ca3bff None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:19.199750 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6532b-76b7-4238-bd6d-a76a91ca3bff None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:19.199750 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6532b-76b7-4238-bd6d-a76a91ca3bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:19.219082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-47a6532b-76b7-4238-bd6d-a76a91ca3bff None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:19.220280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-47a6532b-76b7-4238-bd6d-a76a91ca3bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:19.233521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 362/715] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 28 01:13:19.257035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1a601-2d8a-41a3-bfc0-f7e8eda97043 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:19.272394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1a601-2d8a-41a3-bfc0-f7e8eda97043 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:19.280608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d625c-b983-41d9-b269-5d19de7ed35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:19.281430 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d625c-b983-41d9-b269-5d19de7ed35a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:19.281708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d625c-b983-41d9-b269-5d19de7ed35a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:19.281977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d625c-b983-41d9-b269-5d19de7ed35a admin admin] PATH_INFO: `/v3/services/network` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:19.282650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d625c-b983-41d9-b269-5d19de7ed35a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:19.284222 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d625c-b983-41d9-b269-5d19de7ed35a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:19.297517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-248d625c-b983-41d9-b269-5d19de7ed35a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:13:19.303526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 354/716] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:19 2022] GET /identity/v3/services/network => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:19.304459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6532b-76b7-4238-bd6d-a76a91ca3bff None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:19.318290 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6532b-76b7-4238-bd6d-a76a91ca3bff None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:19.325186 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa9074-ae29-4755-a66a-229475e001c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:19.325864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa9074-ae29-4755-a66a-229475e001c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:19.326142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa9074-ae29-4755-a66a-229475e001c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:19.326409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa9074-ae29-4755-a66a-229475e001c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:19.327138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa9074-ae29-4755-a66a-229475e001c0 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:19.327432 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa9074-ae29-4755-a66a-229475e001c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:19.329022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa9074-ae29-4755-a66a-229475e001c0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:19.337358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 363/717] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:19.343033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d625c-b983-41d9-b269-5d19de7ed35a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:19.358833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d625c-b983-41d9-b269-5d19de7ed35a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:19.364312 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b1782-ff6e-4f2c-a318-fac47abbcc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:19.364987 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b1782-ff6e-4f2c-a318-fac47abbcc75 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:19.365300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b1782-ff6e-4f2c-a318-fac47abbcc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:19.365575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b1782-ff6e-4f2c-a318-fac47abbcc75 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:19.366301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b1782-ff6e-4f2c-a318-fac47abbcc75 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:19.366635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b1782-ff6e-4f2c-a318-fac47abbcc75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:19.367633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-da3b1782-ff6e-4f2c-a318-fac47abbcc75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:19.367633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:13:19.367633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:13:19.368516 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b1782-ff6e-4f2c-a318-fac47abbcc75 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:19.378907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 355/718] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:20.497863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fefa1b-0513-43bf-b18c-fe94b147daf1 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:20.498849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fefa1b-0513-43bf-b18c-fe94b147daf1 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:20.499327 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fefa1b-0513-43bf-b18c-fe94b147daf1 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:20.501614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 364/719] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:20.507237 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80cbed-4ff2-49e0-ab0c-9912c7639260 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:20.507650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80cbed-4ff2-49e0-ab0c-9912c7639260 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:20.507837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80cbed-4ff2-49e0-ab0c-9912c7639260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:20.534197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7a80cbed-4ff2-49e0-ab0c-9912c7639260 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:20.535384 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7a80cbed-4ff2-49e0-ab0c-9912c7639260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:20.543437 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 356/720] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 28 01:13:20.590678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fefa1b-0513-43bf-b18c-fe94b147daf1 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:20.607110 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fefa1b-0513-43bf-b18c-fe94b147daf1 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:20.614855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282a9ca-83dc-4cdb-b2c4-7e9b96cbfdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:20.615566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a9ca-83dc-4cdb-b2c4-7e9b96cbfdc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:20.615846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a9ca-83dc-4cdb-b2c4-7e9b96cbfdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:20.616114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a9ca-83dc-4cdb-b2c4-7e9b96cbfdc6 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:20.616902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282a9ca-83dc-4cdb-b2c4-7e9b96cbfdc6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:20.618049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-b282a9ca-83dc-4cdb-b2c4-7e9b96cbfdc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:20.618049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:13:20.618049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:13:20.618931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282a9ca-83dc-4cdb-b2c4-7e9b96cbfdc6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:20.639463 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 365/721] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:13:20 2022] POST /identity/v3/services => generated 251 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:20.765901 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86621950-0af1-4f7d-b535-2b58b3647d0f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:20.766198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86621950-0af1-4f7d-b535-2b58b3647d0f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:20.766388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86621950-0af1-4f7d-b535-2b58b3647d0f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:20.768378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 357/722] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:20.773681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392916ac-21a4-4111-aeca-8acac559d06d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:20.773961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392916ac-21a4-4111-aeca-8acac559d06d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:20.774229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392916ac-21a4-4111-aeca-8acac559d06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:20.798337 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-392916ac-21a4-4111-aeca-8acac559d06d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:20.799624 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-392916ac-21a4-4111-aeca-8acac559d06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:20.832948 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 366/723] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:20 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:20.874739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86621950-0af1-4f7d-b535-2b58b3647d0f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:20.893495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86621950-0af1-4f7d-b535-2b58b3647d0f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:20.897785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8d694-5fec-48c4-a627-c058c2b86b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:20.898574 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8d694-5fec-48c4-a627-c058c2b86b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:20.898851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8d694-5fec-48c4-a627-c058c2b86b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:20.899116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8d694-5fec-48c4-a627-c058c2b86b45 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:20.911248 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8d694-5fec-48c4-a627-c058c2b86b45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:20.918773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-49e8d694-5fec-48c4-a627-c058c2b86b45 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:13:20.920341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 358/724] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:20.926308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392916ac-21a4-4111-aeca-8acac559d06d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:20.936037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392916ac-21a4-4111-aeca-8acac559d06d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:20.941450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a1e3-6fb5-402f-ac45-ac24ad4a5c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:20.942279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a1e3-6fb5-402f-ac45-ac24ad4a5c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:20.942558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a1e3-6fb5-402f-ac45-ac24ad4a5c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:20.942822 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43a1e3-6fb5-402f-ac45-ac24ad4a5c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:20.943593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43a1e3-6fb5-402f-ac45-ac24ad4a5c37 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:20.943893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43a1e3-6fb5-402f-ac45-ac24ad4a5c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:20.945551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43a1e3-6fb5-402f-ac45-ac24ad4a5c37 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:20.956629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 367/725] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:20.962011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8d694-5fec-48c4-a627-c058c2b86b45 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:20.973352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8d694-5fec-48c4-a627-c058c2b86b45 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:20.977970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1cb05-9616-4a0f-b41d-f9e2578cec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:20.978800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1cb05-9616-4a0f-b41d-f9e2578cec81 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:20.979074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1cb05-9616-4a0f-b41d-f9e2578cec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:20.979338 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1cb05-9616-4a0f-b41d-f9e2578cec81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:20.993341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1cb05-9616-4a0f-b41d-f9e2578cec81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:20.993341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1cb05-9616-4a0f-b41d-f9e2578cec81 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.019938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-5ac1cb05-9616-4a0f-b41d-f9e2578cec81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:21.021805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 359/726] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:21.028073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a1e3-6fb5-402f-ac45-ac24ad4a5c37 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.037895 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43a1e3-6fb5-402f-ac45-ac24ad4a5c37 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.042548 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17fe5e-5733-4d40-8f66-fcfb38f8cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.043543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17fe5e-5733-4d40-8f66-fcfb38f8cb59 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.043959 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17fe5e-5733-4d40-8f66-fcfb38f8cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.044366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17fe5e-5733-4d40-8f66-fcfb38f8cb59 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.045340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17fe5e-5733-4d40-8f66-fcfb38f8cb59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:21.045807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17fe5e-5733-4d40-8f66-fcfb38f8cb59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.047673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17fe5e-5733-4d40-8f66-fcfb38f8cb59 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.061758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 368/727] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:21.070172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1cb05-9616-4a0f-b41d-f9e2578cec81 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.085779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1cb05-9616-4a0f-b41d-f9e2578cec81 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.094388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43048a64-6389-4cdf-8c46-0347aecddaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.095454 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048a64-6389-4cdf-8c46-0347aecddaec admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.095868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048a64-6389-4cdf-8c46-0347aecddaec admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.096271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048a64-6389-4cdf-8c46-0347aecddaec admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.112830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43048a64-6389-4cdf-8c46-0347aecddaec admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.115776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43048a64-6389-4cdf-8c46-0347aecddaec admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.138436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-43048a64-6389-4cdf-8c46-0347aecddaec admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:13:21.139981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 360/728] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:21.146307 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17fe5e-5733-4d40-8f66-fcfb38f8cb59 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.162781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17fe5e-5733-4d40-8f66-fcfb38f8cb59 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.172749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd6235-476b-4eda-83ca-b178b098a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.173452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd6235-476b-4eda-83ca-b178b098a571 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.173727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd6235-476b-4eda-83ca-b178b098a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.173994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd6235-476b-4eda-83ca-b178b098a571 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.174851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd6235-476b-4eda-83ca-b178b098a571 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:21.175160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd6235-476b-4eda-83ca-b178b098a571 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.176982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd6235-476b-4eda-83ca-b178b098a571 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.202142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9a1c0-1158-4977-a79a-ae53efc0fdd8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.202423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9a1c0-1158-4977-a79a-ae53efc0fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.202698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9a1c0-1158-4977-a79a-ae53efc0fdd8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.205826 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 361/729] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:21.215667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbd6d3-feb2-49d9-bdb8-cc21ad0e41eb None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.215950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbd6d3-feb2-49d9-bdb8-cc21ad0e41eb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.216233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbd6d3-feb2-49d9-bdb8-cc21ad0e41eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.217149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 369/730] 10.222.0.16 () {56 vars in 1154 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:21.224224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd6235-476b-4eda-83ca-b178b098a571 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.243908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd6235-476b-4eda-83ca-b178b098a571 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.251790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b18fb-eda8-427c-8ea6-6d1a3af96bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.253002 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-99fbd6d3-feb2-49d9-bdb8-cc21ad0e41eb None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:21.253844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b18fb-eda8-427c-8ea6-6d1a3af96bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.254123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b18fb-eda8-427c-8ea6-6d1a3af96bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.254393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b18fb-eda8-427c-8ea6-6d1a3af96bc2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.255618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-99fbd6d3-feb2-49d9-bdb8-cc21ad0e41eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:21.276208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 362/731] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:21 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:21.287857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b18fb-eda8-427c-8ea6-6d1a3af96bc2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.293314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b18fb-eda8-427c-8ea6-6d1a3af96bc2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.302511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbd6d3-feb2-49d9-bdb8-cc21ad0e41eb None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.312623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbd6d3-feb2-49d9-bdb8-cc21ad0e41eb None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.317325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad1f4f-2877-4def-aac7-16185fd3d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.318109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad1f4f-2877-4def-aac7-16185fd3d39f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.318433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad1f4f-2877-4def-aac7-16185fd3d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.318707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad1f4f-2877-4def-aac7-16185fd3d39f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.320384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-843b18fb-eda8-427c-8ea6-6d1a3af96bc2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:21.323605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 370/732] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:21.330401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad1f4f-2877-4def-aac7-16185fd3d39f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:21.331667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b18fb-eda8-427c-8ea6-6d1a3af96bc2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.337803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-44ad1f4f-2877-4def-aac7-16185fd3d39f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:21.339258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 363/733] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:21.344759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad1f4f-2877-4def-aac7-16185fd3d39f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.358851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b18fb-eda8-427c-8ea6-6d1a3af96bc2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.360414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad1f4f-2877-4def-aac7-16185fd3d39f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.367134 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ac1df-5e7b-41bd-a3ee-1d828beedab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.368696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ac1df-5e7b-41bd-a3ee-1d828beedab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.369380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77866bd5-e2ad-4faa-a7f1-319acb4ff7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.370008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77866bd5-e2ad-4faa-a7f1-319acb4ff7cc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.370279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ac1df-5e7b-41bd-a3ee-1d828beedab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.370550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ac1df-5e7b-41bd-a3ee-1d828beedab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.371314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ac1df-5e7b-41bd-a3ee-1d828beedab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:21.371736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77866bd5-e2ad-4faa-a7f1-319acb4ff7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.372000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77866bd5-e2ad-4faa-a7f1-319acb4ff7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.372742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77866bd5-e2ad-4faa-a7f1-319acb4ff7cc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:21.373040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77866bd5-e2ad-4faa-a7f1-319acb4ff7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.373260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ac1df-5e7b-41bd-a3ee-1d828beedab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.376406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77866bd5-e2ad-4faa-a7f1-319acb4ff7cc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.376964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ac1df-5e7b-41bd-a3ee-1d828beedab8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.397167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 371/734] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:21.397638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 364/735] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:21.403132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ac1df-5e7b-41bd-a3ee-1d828beedab8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.404539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77866bd5-e2ad-4faa-a7f1-319acb4ff7cc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.422369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77866bd5-e2ad-4faa-a7f1-319acb4ff7cc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.424233 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ac1df-5e7b-41bd-a3ee-1d828beedab8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.431273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fc78a-4abc-4da2-85e7-c91d2064b7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.432403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fc78a-4abc-4da2-85e7-c91d2064b7cb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.432692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fc78a-4abc-4da2-85e7-c91d2064b7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.432966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fc78a-4abc-4da2-85e7-c91d2064b7cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.434362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a129fe1-1283-48bd-bb4e-1f72d1e06494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.435203 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a129fe1-1283-48bd-bb4e-1f72d1e06494 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.435491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a129fe1-1283-48bd-bb4e-1f72d1e06494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.436074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a129fe1-1283-48bd-bb4e-1f72d1e06494 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.456135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a129fe1-1283-48bd-bb4e-1f72d1e06494 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.456598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fc78a-4abc-4da2-85e7-c91d2064b7cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.457985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a129fe1-1283-48bd-bb4e-1f72d1e06494 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.458145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fc78a-4abc-4da2-85e7-c91d2064b7cb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.471460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-3a129fe1-1283-48bd-bb4e-1f72d1e06494 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:21.476581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ec2fc78a-4abc-4da2-85e7-c91d2064b7cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:21.477358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 372/736] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:21.485435 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a129fe1-1283-48bd-bb4e-1f72d1e06494 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.485937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 365/737] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:21.494377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fc78a-4abc-4da2-85e7-c91d2064b7cb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.502341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a129fe1-1283-48bd-bb4e-1f72d1e06494 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.512339 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fc78a-4abc-4da2-85e7-c91d2064b7cb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.521255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd091d41-1462-4cd1-8eac-39b932f42440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.525253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd091d41-1462-4cd1-8eac-39b932f42440 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.525253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd091d41-1462-4cd1-8eac-39b932f42440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.525253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd091d41-1462-4cd1-8eac-39b932f42440 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.525253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd091d41-1462-4cd1-8eac-39b932f42440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:21.525253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd091d41-1462-4cd1-8eac-39b932f42440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.529322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd091d41-1462-4cd1-8eac-39b932f42440 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.545280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086ecd-f537-43fb-8383-e173dbfcf45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.545280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ecd-f537-43fb-8383-e173dbfcf45c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.545280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ecd-f537-43fb-8383-e173dbfcf45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.545280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e086ecd-f537-43fb-8383-e173dbfcf45c admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.545697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086ecd-f537-43fb-8383-e173dbfcf45c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:21.545697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086ecd-f537-43fb-8383-e173dbfcf45c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.554735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e086ecd-f537-43fb-8383-e173dbfcf45c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.564481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 373/738] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:21.565531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd091d41-1462-4cd1-8eac-39b932f42440 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.589264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 366/739] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:21.594524 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086ecd-f537-43fb-8383-e173dbfcf45c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.597253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd091d41-1462-4cd1-8eac-39b932f42440 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.616569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e086ecd-f537-43fb-8383-e173dbfcf45c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.617862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b534068-28ad-461a-97c3-c49879fd884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.618744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b534068-28ad-461a-97c3-c49879fd884e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.619040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b534068-28ad-461a-97c3-c49879fd884e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.619317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b534068-28ad-461a-97c3-c49879fd884e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.641038 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2539cf-08a2-4266-a6f8-cc3ccff932c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.642066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2539cf-08a2-4266-a6f8-cc3ccff932c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.645249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2539cf-08a2-4266-a6f8-cc3ccff932c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.645249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2539cf-08a2-4266-a6f8-cc3ccff932c4 admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/43dd173265f24c69af4b13b61722eb51/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.646233 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b534068-28ad-461a-97c3-c49879fd884e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.648396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b534068-28ad-461a-97c3-c49879fd884e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.652442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2539cf-08a2-4266-a6f8-cc3ccff932c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=43dd173265f24c69af4b13b61722eb51, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.655109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2539cf-08a2-4266-a6f8-cc3ccff932c4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.696509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-7b534068-28ad-461a-97c3-c49879fd884e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:13:21.699218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 367/740] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:21 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/43dd173265f24c69af4b13b61722eb51/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:21.700557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 374/741] 10.222.0.16 () {56 vars in 1138 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:21.709967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2539cf-08a2-4266-a6f8-cc3ccff932c4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.814815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2539cf-08a2-4266-a6f8-cc3ccff932c4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.819544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5769-20d5-479f-9d6e-2c58e0c46793 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.820118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5769-20d5-479f-9d6e-2c58e0c46793 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.820612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a5769-20d5-479f-9d6e-2c58e0c46793 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.823011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 375/742] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:21.827329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef10578-3443-4500-bbde-31143b9c589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.827329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef10578-3443-4500-bbde-31143b9c589a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.827329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef10578-3443-4500-bbde-31143b9c589a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.827329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef10578-3443-4500-bbde-31143b9c589a admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.827688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef10578-3443-4500-bbde-31143b9c589a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:21.827688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef10578-3443-4500-bbde-31143b9c589a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.829238 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef10578-3443-4500-bbde-31143b9c589a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.829645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92870414-5266-4a93-bf19-3df29bfb5222 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.830110 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92870414-5266-4a93-bf19-3df29bfb5222 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.830566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92870414-5266-4a93-bf19-3df29bfb5222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.853277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-92870414-5266-4a93-bf19-3df29bfb5222 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:21.854851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-92870414-5266-4a93-bf19-3df29bfb5222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:21.864572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 376/743] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:21 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:21.870188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 368/744] 10.222.0.16 () {56 vars in 1170 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:21.871574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92870414-5266-4a93-bf19-3df29bfb5222 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.884813 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92870414-5266-4a93-bf19-3df29bfb5222 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.891173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563a494-1319-4bec-b6a8-dcd2af461788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.891821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563a494-1319-4bec-b6a8-dcd2af461788 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.892094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563a494-1319-4bec-b6a8-dcd2af461788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.892359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563a494-1319-4bec-b6a8-dcd2af461788 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.901798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef10578-3443-4500-bbde-31143b9c589a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.909978 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563a494-1319-4bec-b6a8-dcd2af461788 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.912193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563a494-1319-4bec-b6a8-dcd2af461788 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.912768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef10578-3443-4500-bbde-31143b9c589a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.923215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09db8e-08ae-4e9e-9927-ede7d9de55f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.923934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 377/745] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/auth/tokens => generated 1018 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:13:21.924073 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09db8e-08ae-4e9e-9927-ede7d9de55f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.924266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09db8e-08ae-4e9e-9927-ede7d9de55f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.924998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09db8e-08ae-4e9e-9927-ede7d9de55f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.930552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563a494-1319-4bec-b6a8-dcd2af461788 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.938805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09db8e-08ae-4e9e-9927-ede7d9de55f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:21.940585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563a494-1319-4bec-b6a8-dcd2af461788 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.945316 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385caaef-23e2-469d-9634-7e0b7424278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.946099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385caaef-23e2-469d-9634-7e0b7424278b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.946462 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385caaef-23e2-469d-9634-7e0b7424278b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.946731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385caaef-23e2-469d-9634-7e0b7424278b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.947108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-4c09db8e-08ae-4e9e-9927-ede7d9de55f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:13:21.948808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 369/746] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:21.954404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09db8e-08ae-4e9e-9927-ede7d9de55f4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.962620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385caaef-23e2-469d-9634-7e0b7424278b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.964893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385caaef-23e2-469d-9634-7e0b7424278b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.966322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09db8e-08ae-4e9e-9927-ede7d9de55f4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:21.973806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a773c-5d18-48e9-9e85-cb2b6561b8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:21.974480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a773c-5d18-48e9-9e85-cb2b6561b8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:21.974755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a773c-5d18-48e9-9e85-cb2b6561b8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:21.975021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a773c-5d18-48e9-9e85-cb2b6561b8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:21.975781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a773c-5d18-48e9-9e85-cb2b6561b8f2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:21.976081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a773c-5d18-48e9-9e85-cb2b6561b8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:21.977700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a773c-5d18-48e9-9e85-cb2b6561b8f2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:21.984340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-385caaef-23e2-469d-9634-7e0b7424278b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:21.986151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 378/747] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:21.989268 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 370/748] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:21.992351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385caaef-23e2-469d-9634-7e0b7424278b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:21.992934 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a773c-5d18-48e9-9e85-cb2b6561b8f2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.002870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385caaef-23e2-469d-9634-7e0b7424278b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.003044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a773c-5d18-48e9-9e85-cb2b6561b8f2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.007380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff656f-7141-4f9c-8c08-2b198b6839e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.008165 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff656f-7141-4f9c-8c08-2b198b6839e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.008438 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff656f-7141-4f9c-8c08-2b198b6839e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.008705 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff656f-7141-4f9c-8c08-2b198b6839e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.009080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedcd0a-a69a-49f5-adfb-452a656b96d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.010004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedcd0a-a69a-49f5-adfb-452a656b96d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.010465 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedcd0a-a69a-49f5-adfb-452a656b96d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.010963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedcd0a-a69a-49f5-adfb-452a656b96d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.011971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedcd0a-a69a-49f5-adfb-452a656b96d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:22.012511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedcd0a-a69a-49f5-adfb-452a656b96d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.014413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedcd0a-a69a-49f5-adfb-452a656b96d3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.019571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff656f-7141-4f9c-8c08-2b198b6839e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.021386 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff656f-7141-4f9c-8c08-2b198b6839e1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.032629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 379/749] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:22.038064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedcd0a-a69a-49f5-adfb-452a656b96d3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.041149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-98ff656f-7141-4f9c-8c08-2b198b6839e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:22.042976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 371/750] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:22.053332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff656f-7141-4f9c-8c08-2b198b6839e1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.053468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedcd0a-a69a-49f5-adfb-452a656b96d3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.064319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc0ef3-81c1-4a65-9a09-e864fb6d9787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.065256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc0ef3-81c1-4a65-9a09-e864fb6d9787 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.065540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc0ef3-81c1-4a65-9a09-e864fb6d9787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.066076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc0ef3-81c1-4a65-9a09-e864fb6d9787 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.069274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff656f-7141-4f9c-8c08-2b198b6839e1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.081415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca20dc1-b4fe-4557-b244-eac5beee39fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.082838 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc0ef3-81c1-4a65-9a09-e864fb6d9787 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.083349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20dc1-b4fe-4557-b244-eac5beee39fe admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.083639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20dc1-b4fe-4557-b244-eac5beee39fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.083912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20dc1-b4fe-4557-b244-eac5beee39fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.086264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca20dc1-b4fe-4557-b244-eac5beee39fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:22.086590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca20dc1-b4fe-4557-b244-eac5beee39fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.088118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc0ef3-81c1-4a65-9a09-e864fb6d9787 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.089034 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca20dc1-b4fe-4557-b244-eac5beee39fe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.113631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-32fc0ef3-81c1-4a65-9a09-e864fb6d9787 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:22.117051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 372/752] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:22.125542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 380/752] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:22.126895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca20dc1-b4fe-4557-b244-eac5beee39fe admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.128167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc0ef3-81c1-4a65-9a09-e864fb6d9787 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.144630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca20dc1-b4fe-4557-b244-eac5beee39fe admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.148667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc0ef3-81c1-4a65-9a09-e864fb6d9787 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.152738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d38034-17f1-4903-8a86-97d70d32c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.153931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d38034-17f1-4903-8a86-97d70d32c63b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.154712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d38034-17f1-4903-8a86-97d70d32c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.154982 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d38034-17f1-4903-8a86-97d70d32c63b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.158639 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab55750-d4f6-4565-b058-0d068f9fc846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.159833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab55750-d4f6-4565-b058-0d068f9fc846 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.160093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab55750-d4f6-4565-b058-0d068f9fc846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.160361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab55750-d4f6-4565-b058-0d068f9fc846 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.163691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab55750-d4f6-4565-b058-0d068f9fc846 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:22.163998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab55750-d4f6-4565-b058-0d068f9fc846 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.168118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab55750-d4f6-4565-b058-0d068f9fc846 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.173859 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d38034-17f1-4903-8a86-97d70d32c63b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.175887 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d38034-17f1-4903-8a86-97d70d32c63b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.191461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 381/753] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:22.202498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab55750-d4f6-4565-b058-0d068f9fc846 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.205204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-d6d38034-17f1-4903-8a86-97d70d32c63b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:13:22.206577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 373/754] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:22.220313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab55750-d4f6-4565-b058-0d068f9fc846 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.223037 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d38034-17f1-4903-8a86-97d70d32c63b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.234900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af5b11-d447-47dc-bf70-e14120ff40b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.235557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af5b11-d447-47dc-bf70-e14120ff40b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.235885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af5b11-d447-47dc-bf70-e14120ff40b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.236153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af5b11-d447-47dc-bf70-e14120ff40b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.237053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af5b11-d447-47dc-bf70-e14120ff40b7 admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=b3b098dc0f2f465f947df6e136b33f68) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:22.237385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af5b11-d447-47dc-bf70-e14120ff40b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.239465 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af5b11-d447-47dc-bf70-e14120ff40b7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.242053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d38034-17f1-4903-8a86-97d70d32c63b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.252480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450d989-de70-45d4-84e2-dab9d1f3ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.253179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450d989-de70-45d4-84e2-dab9d1f3ae9a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.253477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450d989-de70-45d4-84e2-dab9d1f3ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.254292 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 382/755] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/role_assignments?user.id=b3b098dc0f2f465f947df6e136b33f68&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:22.254488 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450d989-de70-45d4-84e2-dab9d1f3ae9a admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.255365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450d989-de70-45d4-84e2-dab9d1f3ae9a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:22.255666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450d989-de70-45d4-84e2-dab9d1f3ae9a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.257582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450d989-de70-45d4-84e2-dab9d1f3ae9a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.288621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 374/756] 10.222.0.16 () {56 vars in 1156 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:22.294367 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af5b11-d447-47dc-bf70-e14120ff40b7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.304447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af5b11-d447-47dc-bf70-e14120ff40b7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.313902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc3d44-b02a-4dc4-b21b-6050b2d7bda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.314566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3d44-b02a-4dc4-b21b-6050b2d7bda5 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.314874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3d44-b02a-4dc4-b21b-6050b2d7bda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.315147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3d44-b02a-4dc4-b21b-6050b2d7bda5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.324314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc3d44-b02a-4dc4-b21b-6050b2d7bda5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.326231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc3d44-b02a-4dc4-b21b-6050b2d7bda5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.338284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d3ed4-2651-44a7-ac80-7bb291150969 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.338632 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d3ed4-2651-44a7-ac80-7bb291150969 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.338786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 383/757] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/auth/tokens => generated 1018 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:13:22.338939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d3ed4-2651-44a7-ac80-7bb291150969 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.340680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 375/758] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:22.346530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca0c7-de9d-46eb-b581-168e3727b935 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.346861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca0c7-de9d-46eb-b581-168e3727b935 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.347139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdca0c7-de9d-46eb-b581-168e3727b935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.351585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc3d44-b02a-4dc4-b21b-6050b2d7bda5 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.370118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc3d44-b02a-4dc4-b21b-6050b2d7bda5 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.380814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c58a37-e694-4a19-aacf-8755ca3e9be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.382003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4cdca0c7-de9d-46eb-b581-168e3727b935 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:22.382850 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c58a37-e694-4a19-aacf-8755ca3e9be8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.383131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c58a37-e694-4a19-aacf-8755ca3e9be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.383403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c58a37-e694-4a19-aacf-8755ca3e9be8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.385174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4cdca0c7-de9d-46eb-b581-168e3727b935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:22.405671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 376/759] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:22 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:22.413562 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c58a37-e694-4a19-aacf-8755ca3e9be8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.415570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c58a37-e694-4a19-aacf-8755ca3e9be8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.434575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdca0c7-de9d-46eb-b581-168e3727b935 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.441094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-e0c58a37-e694-4a19-aacf-8755ca3e9be8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:22.442463 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 384/760] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:22.448389 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c58a37-e694-4a19-aacf-8755ca3e9be8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.455833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdca0c7-de9d-46eb-b581-168e3727b935 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.458996 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c58a37-e694-4a19-aacf-8755ca3e9be8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.464033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a0497-7ac6-4f41-bc50-bdf27e9a5b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.464877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a0497-7ac6-4f41-bc50-bdf27e9a5b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.465214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a0497-7ac6-4f41-bc50-bdf27e9a5b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.465534 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a0497-7ac6-4f41-bc50-bdf27e9a5b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.466494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a0497-7ac6-4f41-bc50-bdf27e9a5b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:22.466798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a0497-7ac6-4f41-bc50-bdf27e9a5b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.468532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a0497-7ac6-4f41-bc50-bdf27e9a5b58 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.473956 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac05c1a-c951-4af1-9a17-b52209416324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.474643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac05c1a-c951-4af1-9a17-b52209416324 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.474927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac05c1a-c951-4af1-9a17-b52209416324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.475198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac05c1a-c951-4af1-9a17-b52209416324 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.475950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac05c1a-c951-4af1-9a17-b52209416324 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.476992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-aac05c1a-c951-4af1-9a17-b52209416324 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:22.476992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:13:22.476992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:13:22.478001 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac05c1a-c951-4af1-9a17-b52209416324 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.487775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 385/761] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:22.488566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a0497-7ac6-4f41-bc50-bdf27e9a5b58 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.500693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a0497-7ac6-4f41-bc50-bdf27e9a5b58 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.505730 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940c0ec-4b0f-4d29-b67f-2039f3729cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.506571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940c0ec-4b0f-4d29-b67f-2039f3729cca admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.506849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940c0ec-4b0f-4d29-b67f-2039f3729cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.507123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940c0ec-4b0f-4d29-b67f-2039f3729cca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.512536 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 377/762] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:13:22 2022] POST /identity/v3/services => generated 240 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:13:22.520940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940c0ec-4b0f-4d29-b67f-2039f3729cca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.523267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940c0ec-4b0f-4d29-b67f-2039f3729cca admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.538679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-c940c0ec-4b0f-4d29-b67f-2039f3729cca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:22.544835 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 386/763] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:22.546327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac05c1a-c951-4af1-9a17-b52209416324 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.575688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac05c1a-c951-4af1-9a17-b52209416324 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.580246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2bd94-7919-445b-bb5c-c8d1cf7bfd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.580971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2bd94-7919-445b-bb5c-c8d1cf7bfd85 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.581273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2bd94-7919-445b-bb5c-c8d1cf7bfd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.581562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2bd94-7919-445b-bb5c-c8d1cf7bfd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.582465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2bd94-7919-445b-bb5c-c8d1cf7bfd85 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:22.582793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2bd94-7919-445b-bb5c-c8d1cf7bfd85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.584854 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2bd94-7919-445b-bb5c-c8d1cf7bfd85 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.602827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 378/764] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:22.605208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940c0ec-4b0f-4d29-b67f-2039f3729cca admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:22.636209 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940c0ec-4b0f-4d29-b67f-2039f3729cca admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:22.643303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409824b-7ff9-48aa-943a-9103570f596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:22.644291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409824b-7ff9-48aa-943a-9103570f596c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:22.644713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409824b-7ff9-48aa-943a-9103570f596c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:22.645119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409824b-7ff9-48aa-943a-9103570f596c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:22.646484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409824b-7ff9-48aa-943a-9103570f596c admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=ca65456d336b4c3898831af80e6435a6) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:22.647024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409824b-7ff9-48aa-943a-9103570f596c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:22.650191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409824b-7ff9-48aa-943a-9103570f596c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:22.665443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 387/765] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:22 2022] GET /identity/v3/role_assignments?user.id=ca65456d336b4c3898831af80e6435a6&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:23.549065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c52d1-f318-4e3f-a752-741b7077c573 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:23.549808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c52d1-f318-4e3f-a752-741b7077c573 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:23.549808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c52d1-f318-4e3f-a752-741b7077c573 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:23.551645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 379/766] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:23.557090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b3aa-d7e3-4b4c-9d19-9cf9e9029b84 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:23.557586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b3aa-d7e3-4b4c-9d19-9cf9e9029b84 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:23.557734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b3aa-d7e3-4b4c-9d19-9cf9e9029b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:23.582873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-feb3b3aa-d7e3-4b4c-9d19-9cf9e9029b84 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:23.584057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-feb3b3aa-d7e3-4b4c-9d19-9cf9e9029b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:23.596589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 388/767] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:23 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:23.624346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c52d1-f318-4e3f-a752-741b7077c573 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:23.641896 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c52d1-f318-4e3f-a752-741b7077c573 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:23.649908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc3b0c-5639-422e-a6b0-1a61c9230c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:23.650715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc3b0c-5639-422e-a6b0-1a61c9230c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:23.650985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc3b0c-5639-422e-a6b0-1a61c9230c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:23.651249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc3b0c-5639-422e-a6b0-1a61c9230c38 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:23.651912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc3b0c-5639-422e-a6b0-1a61c9230c38 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:23.653607 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc3b0c-5639-422e-a6b0-1a61c9230c38 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:23.672912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-8fcc3b0c-5639-422e-a6b0-1a61c9230c38 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:13:23.674551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 380/768] 10.222.0.16 () {56 vars in 1150 bytes} [Fri Jan 28 01:13:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:23.680690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3b3aa-d7e3-4b4c-9d19-9cf9e9029b84 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:23.694409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3b3aa-d7e3-4b4c-9d19-9cf9e9029b84 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:23.705318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f8bb5-b214-451c-8a0f-3cf7d10897e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:23.705983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f8bb5-b214-451c-8a0f-3cf7d10897e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:23.706258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f8bb5-b214-451c-8a0f-3cf7d10897e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:23.706526 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f8bb5-b214-451c-8a0f-3cf7d10897e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:23.707251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f8bb5-b214-451c-8a0f-3cf7d10897e0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:23.707550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f8bb5-b214-451c-8a0f-3cf7d10897e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:23.709144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f8bb5-b214-451c-8a0f-3cf7d10897e0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:23.717550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 389/769] 10.222.0.16 () {56 vars in 1145 bytes} [Fri Jan 28 01:13:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:23.723435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc3b0c-5639-422e-a6b0-1a61c9230c38 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:23.733604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc3b0c-5639-422e-a6b0-1a61c9230c38 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:23.744231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05149a-f193-4c5c-a59a-ad5bbe35809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:23.744888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05149a-f193-4c5c-a59a-ad5bbe35809e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:23.745160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05149a-f193-4c5c-a59a-ad5bbe35809e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:23.745451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05149a-f193-4c5c-a59a-ad5bbe35809e admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:23.746307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05149a-f193-4c5c-a59a-ad5bbe35809e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:23.746606 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05149a-f193-4c5c-a59a-ad5bbe35809e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:23.748389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05149a-f193-4c5c-a59a-ad5bbe35809e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:23.753858 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 381/770] 10.222.0.16 () {56 vars in 1145 bytes} [Fri Jan 28 01:13:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:23.759601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f8bb5-b214-451c-8a0f-3cf7d10897e0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:23.770365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f8bb5-b214-451c-8a0f-3cf7d10897e0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:23.780387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01017d-e04d-42e5-8a2b-6cad9e49a71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:23.781113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01017d-e04d-42e5-8a2b-6cad9e49a71c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:23.781437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01017d-e04d-42e5-8a2b-6cad9e49a71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:23.781714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01017d-e04d-42e5-8a2b-6cad9e49a71c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:23.782539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01017d-e04d-42e5-8a2b-6cad9e49a71c admin admin] RBAC: Adding query filter params (interface=public, service_id=b1a1976b24a941f0aba3d4927077fda6, region_id=RegionOne) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:23.782846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01017d-e04d-42e5-8a2b-6cad9e49a71c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:23.783930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-db01017d-e04d-42e5-8a2b-6cad9e49a71c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:23.783930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:13:23.783930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:13:23.784820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01017d-e04d-42e5-8a2b-6cad9e49a71c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:23.796394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 390/771] 10.222.0.16 () {56 vars in 1272 bytes} [Fri Jan 28 01:13:23 2022] GET /identity/v3/endpoints?service_id=b1a1976b24a941f0aba3d4927077fda6&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:23.801964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05149a-f193-4c5c-a59a-ad5bbe35809e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:23.811652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05149a-f193-4c5c-a59a-ad5bbe35809e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:23.824302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a861b8d-52bd-469c-aacb-027590512f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:23.824967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a861b8d-52bd-469c-aacb-027590512f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:23.825252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a861b8d-52bd-469c-aacb-027590512f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:23.825538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a861b8d-52bd-469c-aacb-027590512f8d admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:23.826231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a861b8d-52bd-469c-aacb-027590512f8d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:23.827838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a861b8d-52bd-469c-aacb-027590512f8d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:23.833653 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 382/772] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:13:23 2022] GET /identity/v3/services => generated 772 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:24.497459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990e73-61fb-4d68-adad-ecbcf63abafe None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.497459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990e73-61fb-4d68-adad-ecbcf63abafe None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.497459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990e73-61fb-4d68-adad-ecbcf63abafe None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.497459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 391/773] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:24.502638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61927b80-f7e2-452e-8e55-0e14457a7bc8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.502926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61927b80-f7e2-452e-8e55-0e14457a7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.503198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61927b80-f7e2-452e-8e55-0e14457a7bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.527743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-61927b80-f7e2-452e-8e55-0e14457a7bc8 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:24.528948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-61927b80-f7e2-452e-8e55-0e14457a7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:24.536905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 383/774] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:24 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:24.582720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03990e73-61fb-4d68-adad-ecbcf63abafe None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:24.597133 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03990e73-61fb-4d68-adad-ecbcf63abafe None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:24.607262 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e981d-58a8-443a-bf39-d1bd4ffac282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:24.608088 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e981d-58a8-443a-bf39-d1bd4ffac282 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.608360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e981d-58a8-443a-bf39-d1bd4ffac282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.608629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e981d-58a8-443a-bf39-d1bd4ffac282 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.626964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e981d-58a8-443a-bf39-d1bd4ffac282 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:24.633943 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-9c1e981d-58a8-443a-bf39-d1bd4ffac282 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:13:24.635161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 392/775] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:24.641019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61927b80-f7e2-452e-8e55-0e14457a7bc8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:24.653687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61927b80-f7e2-452e-8e55-0e14457a7bc8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:24.661187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccd21f-2955-45c1-bce1-cd0f3dfe6a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:24.661874 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccd21f-2955-45c1-bce1-cd0f3dfe6a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.662152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccd21f-2955-45c1-bce1-cd0f3dfe6a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.662426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccd21f-2955-45c1-bce1-cd0f3dfe6a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.663188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccd21f-2955-45c1-bce1-cd0f3dfe6a62 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:24.663490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccd21f-2955-45c1-bce1-cd0f3dfe6a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:24.665103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccd21f-2955-45c1-bce1-cd0f3dfe6a62 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:24.678679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 384/776] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:24.683853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e981d-58a8-443a-bf39-d1bd4ffac282 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:24.698396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e981d-58a8-443a-bf39-d1bd4ffac282 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:24.709418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce389-da94-45af-9163-2b2c9b4afad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:24.710210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce389-da94-45af-9163-2b2c9b4afad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.710485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce389-da94-45af-9163-2b2c9b4afad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.710758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ce389-da94-45af-9163-2b2c9b4afad3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.726571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ce389-da94-45af-9163-2b2c9b4afad3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:24.728412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ce389-da94-45af-9163-2b2c9b4afad3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:24.749046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-6d3ce389-da94-45af-9163-2b2c9b4afad3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:24.750189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 393/777] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:24.756047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccd21f-2955-45c1-bce1-cd0f3dfe6a62 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:24.770477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccd21f-2955-45c1-bce1-cd0f3dfe6a62 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:24.777183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cef04-13c6-4bb4-aa32-38645b43ce18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:24.777931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cef04-13c6-4bb4-aa32-38645b43ce18 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.778210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cef04-13c6-4bb4-aa32-38645b43ce18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.778485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cef04-13c6-4bb4-aa32-38645b43ce18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.779286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cef04-13c6-4bb4-aa32-38645b43ce18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:24.779591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cef04-13c6-4bb4-aa32-38645b43ce18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:24.781288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cef04-13c6-4bb4-aa32-38645b43ce18 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:24.799478 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 385/778] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:24.804895 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce389-da94-45af-9163-2b2c9b4afad3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:24.818237 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ce389-da94-45af-9163-2b2c9b4afad3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:24.825287 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123e3f7-68b1-4ffc-b1c4-b80eb7553ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:24.826075 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123e3f7-68b1-4ffc-b1c4-b80eb7553ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.826349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123e3f7-68b1-4ffc-b1c4-b80eb7553ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.826614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123e3f7-68b1-4ffc-b1c4-b80eb7553ce6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.842355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123e3f7-68b1-4ffc-b1c4-b80eb7553ce6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:24.844398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123e3f7-68b1-4ffc-b1c4-b80eb7553ce6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:24.856731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bf7e6-eb50-4695-b11c-2320cd03494b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.857007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bf7e6-eb50-4695-b11c-2320cd03494b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.857322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bf7e6-eb50-4695-b11c-2320cd03494b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.859392 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 386/779] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:24.862207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-e123e3f7-68b1-4ffc-b1c4-b80eb7553ce6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:13:24.863644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 394/780] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jan 28 01:13:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:24.869124 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bf7e6-eb50-4695-b11c-2320cd03494b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:24.872264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3661cd-326e-40f9-a19d-27a6861997de None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.872550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3661cd-326e-40f9-a19d-27a6861997de None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.872820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3661cd-326e-40f9-a19d-27a6861997de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.889723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bf7e6-eb50-4695-b11c-2320cd03494b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:24.892650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-df3661cd-326e-40f9-a19d-27a6861997de None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:24.894045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-df3661cd-326e-40f9-a19d-27a6861997de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:24.899181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5a8ea-8320-417b-a595-59542380b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:24.899862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a8ea-8320-417b-a595-59542380b4ca admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.900136 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a8ea-8320-417b-a595-59542380b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.900461 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5a8ea-8320-417b-a595-59542380b4ca admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.901600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5a8ea-8320-417b-a595-59542380b4ca admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:24.901910 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5a8ea-8320-417b-a595-59542380b4ca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:24.903339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 395/781] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:24 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:24.905050 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5a8ea-8320-417b-a595-59542380b4ca admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:24.926812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3661cd-326e-40f9-a19d-27a6861997de None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:24.938729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3661cd-326e-40f9-a19d-27a6861997de None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:24.943688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 387/782] 10.222.0.16 () {56 vars in 1154 bytes} [Fri Jan 28 01:13:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:24.950684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5a8ea-8320-417b-a595-59542380b4ca admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:24.958585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e764f44-0c52-4dc6-98de-57150a91e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:24.959392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764f44-0c52-4dc6-98de-57150a91e726 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.959664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764f44-0c52-4dc6-98de-57150a91e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.959932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764f44-0c52-4dc6-98de-57150a91e726 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.969741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5a8ea-8320-417b-a595-59542380b4ca admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:24.977830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e764f44-0c52-4dc6-98de-57150a91e726 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:24.978222 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be362-72da-4c43-9c1f-2337bdd258e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:24.978869 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be362-72da-4c43-9c1f-2337bdd258e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:24.979146 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be362-72da-4c43-9c1f-2337bdd258e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:24.979414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38be362-72da-4c43-9c1f-2337bdd258e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:24.985243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-6e764f44-0c52-4dc6-98de-57150a91e726 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:24.986942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 396/783] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:24.992710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e764f44-0c52-4dc6-98de-57150a91e726 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:24.998281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38be362-72da-4c43-9c1f-2337bdd258e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.000105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38be362-72da-4c43-9c1f-2337bdd258e2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.003154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e764f44-0c52-4dc6-98de-57150a91e726 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.007698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a9496-6b46-4520-9808-baa47b201277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.008343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a9496-6b46-4520-9808-baa47b201277 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.008619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a9496-6b46-4520-9808-baa47b201277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.008893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a9496-6b46-4520-9808-baa47b201277 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.009688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a9496-6b46-4520-9808-baa47b201277 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.009990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a9496-6b46-4520-9808-baa47b201277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.012442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a9496-6b46-4520-9808-baa47b201277 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.020512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 388/784] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:24 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:13:25.029905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 397/785] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:25.030537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be362-72da-4c43-9c1f-2337bdd258e2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.031915 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a9496-6b46-4520-9808-baa47b201277 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.042129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a9496-6b46-4520-9808-baa47b201277 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.047185 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17143c9-3eaf-4865-ab34-fec080f985b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.047621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38be362-72da-4c43-9c1f-2337bdd258e2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.048049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17143c9-3eaf-4865-ab34-fec080f985b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.048428 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17143c9-3eaf-4865-ab34-fec080f985b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.048748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17143c9-3eaf-4865-ab34-fec080f985b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.060387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17143c9-3eaf-4865-ab34-fec080f985b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.062552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17143c9-3eaf-4865-ab34-fec080f985b0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.065922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06f876-91d6-42b2-96a2-87690950cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.066723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06f876-91d6-42b2-96a2-87690950cf13 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.066994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06f876-91d6-42b2-96a2-87690950cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.067256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06f876-91d6-42b2-96a2-87690950cf13 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.083427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-a17143c9-3eaf-4865-ab34-fec080f985b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:25.084938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 398/786] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:25.090743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06f876-91d6-42b2-96a2-87690950cf13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.090967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17143c9-3eaf-4865-ab34-fec080f985b0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.092687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06f876-91d6-42b2-96a2-87690950cf13 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.102407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17143c9-3eaf-4865-ab34-fec080f985b0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.107325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b2e4-bff1-4117-a77a-8fcde1575278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.108021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b2e4-bff1-4117-a77a-8fcde1575278 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.108294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b2e4-bff1-4117-a77a-8fcde1575278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.108613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b2e4-bff1-4117-a77a-8fcde1575278 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.109470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b2e4-bff1-4117-a77a-8fcde1575278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.109769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b2e4-bff1-4117-a77a-8fcde1575278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.111866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b2e4-bff1-4117-a77a-8fcde1575278 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.124391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 399/787] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.130049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b2e4-bff1-4117-a77a-8fcde1575278 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.136463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-5a06f876-91d6-42b2-96a2-87690950cf13 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:25.141252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 389/788] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:25.143804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b2e4-bff1-4117-a77a-8fcde1575278 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.148452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe0e4b-e4aa-474d-a6cf-764f6dc5c58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.149499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe0e4b-e4aa-474d-a6cf-764f6dc5c58b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.149947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe0e4b-e4aa-474d-a6cf-764f6dc5c58b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.150386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe0e4b-e4aa-474d-a6cf-764f6dc5c58b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.154763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06f876-91d6-42b2-96a2-87690950cf13 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.160628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe0e4b-e4aa-474d-a6cf-764f6dc5c58b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.163246 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe0e4b-e4aa-474d-a6cf-764f6dc5c58b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.172661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06f876-91d6-42b2-96a2-87690950cf13 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.180344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-dffe0e4b-e4aa-474d-a6cf-764f6dc5c58b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:13:25.181479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b2320-8dcc-4541-ba78-cfdc02da4911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.182303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b2320-8dcc-4541-ba78-cfdc02da4911 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.182473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b2320-8dcc-4541-ba78-cfdc02da4911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.182831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b2320-8dcc-4541-ba78-cfdc02da4911 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.183026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 400/789] 10.222.0.16 () {56 vars in 1138 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:25.187788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b2320-8dcc-4541-ba78-cfdc02da4911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.187788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b2320-8dcc-4541-ba78-cfdc02da4911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.187788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b2320-8dcc-4541-ba78-cfdc02da4911 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.189783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe0e4b-e4aa-474d-a6cf-764f6dc5c58b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.210968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 390/790] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:25.213455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe0e4b-e4aa-474d-a6cf-764f6dc5c58b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.216888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b2320-8dcc-4541-ba78-cfdc02da4911 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.224604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fae879-d3a1-44f9-acb9-9818baa455ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.225541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fae879-d3a1-44f9-acb9-9818baa455ba admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.225990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fae879-d3a1-44f9-acb9-9818baa455ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.226459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fae879-d3a1-44f9-acb9-9818baa455ba admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.227485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fae879-d3a1-44f9-acb9-9818baa455ba admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.227967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fae879-d3a1-44f9-acb9-9818baa455ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.231699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fae879-d3a1-44f9-acb9-9818baa455ba admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.237787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b2320-8dcc-4541-ba78-cfdc02da4911 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.251167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8147d8a-6705-4582-8a2c-ba9be483191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.251912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8147d8a-6705-4582-8a2c-ba9be483191c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.252193 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8147d8a-6705-4582-8a2c-ba9be483191c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.252467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8147d8a-6705-4582-8a2c-ba9be483191c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.258680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 401/791] 10.222.0.16 () {56 vars in 1170 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.264470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fae879-d3a1-44f9-acb9-9818baa455ba admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.269962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8147d8a-6705-4582-8a2c-ba9be483191c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.271974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8147d8a-6705-4582-8a2c-ba9be483191c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.276493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fae879-d3a1-44f9-acb9-9818baa455ba admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.281197 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9e6bc-9112-4d96-956e-ef1b0f0ab549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.282057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9e6bc-9112-4d96-956e-ef1b0f0ab549 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.282372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9e6bc-9112-4d96-956e-ef1b0f0ab549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.282724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9e6bc-9112-4d96-956e-ef1b0f0ab549 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.287854 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c8147d8a-6705-4582-8a2c-ba9be483191c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:25.289513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 391/792] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:25.290846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaea6c-bbf7-4f76-be88-150f4587be73 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.291127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaea6c-bbf7-4f76-be88-150f4587be73 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.291396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaea6c-bbf7-4f76-be88-150f4587be73 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.293542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9e6bc-9112-4d96-956e-ef1b0f0ab549 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.295578 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9e6bc-9112-4d96-956e-ef1b0f0ab549 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.297435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 392/793] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:25.298605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85969-8183-4655-a0f6-fd3a248eeeae None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.298888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85969-8183-4655-a0f6-fd3a248eeeae None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.299157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85969-8183-4655-a0f6-fd3a248eeeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.313905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-f3f9e6bc-9112-4d96-956e-ef1b0f0ab549 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:25.315637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 402/794] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:25.316659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9e6bc-9112-4d96-956e-ef1b0f0ab549 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.316836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f0f85969-8183-4655-a0f6-fd3a248eeeae None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:25.318262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f0f85969-8183-4655-a0f6-fd3a248eeeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:25.326699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9e6bc-9112-4d96-956e-ef1b0f0ab549 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.327802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 393/795] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:25 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:25.331622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f891-0518-4ba7-b161-ab2cf53db370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.332455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f891-0518-4ba7-b161-ab2cf53db370 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.332918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f891-0518-4ba7-b161-ab2cf53db370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.333379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f891-0518-4ba7-b161-ab2cf53db370 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.334371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f891-0518-4ba7-b161-ab2cf53db370 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.334836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f891-0518-4ba7-b161-ab2cf53db370 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.336832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f891-0518-4ba7-b161-ab2cf53db370 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.337303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f85969-8183-4655-a0f6-fd3a248eeeae None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.352473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f85969-8183-4655-a0f6-fd3a248eeeae None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.354740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 403/796] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.359745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaea425-06f4-43f0-abce-0a155c29285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.361079 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f891-0518-4ba7-b161-ab2cf53db370 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.362086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaea425-06f4-43f0-abce-0a155c29285e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.365485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaea425-06f4-43f0-abce-0a155c29285e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.365829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaea425-06f4-43f0-abce-0a155c29285e admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.366611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaea425-06f4-43f0-abce-0a155c29285e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.366916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaea425-06f4-43f0-abce-0a155c29285e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.369582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaea425-06f4-43f0-abce-0a155c29285e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.372721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f891-0518-4ba7-b161-ab2cf53db370 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.377903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262118a3-a591-42f4-9260-2eeeab18d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.378600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262118a3-a591-42f4-9260-2eeeab18d740 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.378874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262118a3-a591-42f4-9260-2eeeab18d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.379148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262118a3-a591-42f4-9260-2eeeab18d740 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.380052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262118a3-a591-42f4-9260-2eeeab18d740 admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=43dd173265f24c69af4b13b61722eb51) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.380354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262118a3-a591-42f4-9260-2eeeab18d740 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.382340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262118a3-a591-42f4-9260-2eeeab18d740 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.383686 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 394/797] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.384878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaea425-06f4-43f0-abce-0a155c29285e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.389267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 404/798] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/role_assignments?user.id=43dd173265f24c69af4b13b61722eb51&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:25.391906 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262118a3-a591-42f4-9260-2eeeab18d740 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.404053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaea425-06f4-43f0-abce-0a155c29285e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.406511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262118a3-a591-42f4-9260-2eeeab18d740 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.415335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cce04-03a2-41aa-abc8-c0456d4a2d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.416307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34397c9-db88-4f54-a195-8d399fdba17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.417412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cce04-03a2-41aa-abc8-c0456d4a2d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.418495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34397c9-db88-4f54-a195-8d399fdba17b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.419041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cce04-03a2-41aa-abc8-c0456d4a2d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.419504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34397c9-db88-4f54-a195-8d399fdba17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.419957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cce04-03a2-41aa-abc8-c0456d4a2d0d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.420388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34397c9-db88-4f54-a195-8d399fdba17b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.433628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cce04-03a2-41aa-abc8-c0456d4a2d0d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.436775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cce04-03a2-41aa-abc8-c0456d4a2d0d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.448798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34397c9-db88-4f54-a195-8d399fdba17b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:25.456181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-f34397c9-db88-4f54-a195-8d399fdba17b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:13:25.458212 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 395/799] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:25.465777 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-c52cce04-03a2-41aa-abc8-c0456d4a2d0d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:25.467052 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34397c9-db88-4f54-a195-8d399fdba17b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.469426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 405/800] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:25.475690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cce04-03a2-41aa-abc8-c0456d4a2d0d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.486602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34397c9-db88-4f54-a195-8d399fdba17b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.488083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cce04-03a2-41aa-abc8-c0456d4a2d0d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.492818 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5feb927-1486-46a0-92fa-9e0e139124f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.493972 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feb927-1486-46a0-92fa-9e0e139124f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.494112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc4141-0234-48cf-afd6-9129850e31fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.494621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feb927-1486-46a0-92fa-9e0e139124f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.494727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc4141-0234-48cf-afd6-9129850e31fd admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.495008 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc4141-0234-48cf-afd6-9129850e31fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.495277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc4141-0234-48cf-afd6-9129850e31fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.495580 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feb927-1486-46a0-92fa-9e0e139124f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.496235 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc4141-0234-48cf-afd6-9129850e31fd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.496543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc4141-0234-48cf-afd6-9129850e31fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.497271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5feb927-1486-46a0-92fa-9e0e139124f4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.497753 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5feb927-1486-46a0-92fa-9e0e139124f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.498511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc4141-0234-48cf-afd6-9129850e31fd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.499871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5feb927-1486-46a0-92fa-9e0e139124f4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.511866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 396/801] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.513752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4754d0-2a87-4e91-8e04-b136b9f576a7 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.514217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4754d0-2a87-4e91-8e04-b136b9f576a7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.514660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4754d0-2a87-4e91-8e04-b136b9f576a7 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.516564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 397/802] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:25.517473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4754d0-2a87-4e91-8e04-b136b9f576a7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.517630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 406/803] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.519590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc4141-0234-48cf-afd6-9129850e31fd admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.534872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc4141-0234-48cf-afd6-9129850e31fd admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.535113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4754d0-2a87-4e91-8e04-b136b9f576a7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.539921 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329d0e9-2143-4b6a-8fbd-16b489bd9c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.540761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3f2e0-1945-4df2-be6a-ff9f72d19a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.540881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329d0e9-2143-4b6a-8fbd-16b489bd9c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.541094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329d0e9-2143-4b6a-8fbd-16b489bd9c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.541413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329d0e9-2143-4b6a-8fbd-16b489bd9c06 admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/b3b098dc0f2f465f947df6e136b33f68/roles/13ec9c0076334780847c0f750f4af8f4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.542405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3f2e0-1945-4df2-be6a-ff9f72d19a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.543208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3f2e0-1945-4df2-be6a-ff9f72d19a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.543882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3f2e0-1945-4df2-be6a-ff9f72d19a25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.558142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3f2e0-1945-4df2-be6a-ff9f72d19a25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.560854 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329d0e9-2143-4b6a-8fbd-16b489bd9c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=b3b098dc0f2f465f947df6e136b33f68, role_id=13ec9c0076334780847c0f750f4af8f4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.561123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3f2e0-1945-4df2-be6a-ff9f72d19a25 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.564621 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329d0e9-2143-4b6a-8fbd-16b489bd9c06 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.581036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 407/804] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:25 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/b3b098dc0f2f465f947df6e136b33f68/roles/13ec9c0076334780847c0f750f4af8f4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:25.582312 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-37b3f2e0-1945-4df2-be6a-ff9f72d19a25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:25.583765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 398/805] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:25.586859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a33e0-17a8-4054-b7d7-f7ff218c2980 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.587769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a33e0-17a8-4054-b7d7-f7ff218c2980 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.588309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a33e0-17a8-4054-b7d7-f7ff218c2980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.590767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3f2e0-1945-4df2-be6a-ff9f72d19a25 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.602632 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3f2e0-1945-4df2-be6a-ff9f72d19a25 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.613213 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-a61a33e0-17a8-4054-b7d7-f7ff218c2980 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:25.614683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a61a33e0-17a8-4054-b7d7-f7ff218c2980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:25.678547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ae458-e3b1-4942-9f40-9776eefce61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.680150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae458-e3b1-4942-9f40-9776eefce61b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.680574 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae458-e3b1-4942-9f40-9776eefce61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.680988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae458-e3b1-4942-9f40-9776eefce61b admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.681909 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ae458-e3b1-4942-9f40-9776eefce61b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.682211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ae458-e3b1-4942-9f40-9776eefce61b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.683990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ae458-e3b1-4942-9f40-9776eefce61b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.685445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 408/806] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:25 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:25.696039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 399/807] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.701955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a33e0-17a8-4054-b7d7-f7ff218c2980 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.711596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a33e0-17a8-4054-b7d7-f7ff218c2980 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.715164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ae458-e3b1-4942-9f40-9776eefce61b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.716851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39d36-7e5d-435c-adb0-e23cb9295553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.717802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39d36-7e5d-435c-adb0-e23cb9295553 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.718177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39d36-7e5d-435c-adb0-e23cb9295553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.718540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39d36-7e5d-435c-adb0-e23cb9295553 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.727050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc39d36-7e5d-435c-adb0-e23cb9295553 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.729085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc39d36-7e5d-435c-adb0-e23cb9295553 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.736022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ae458-e3b1-4942-9f40-9776eefce61b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.740894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bd8eb-3a2e-41d9-a7cf-bcda0d695b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.741780 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bd8eb-3a2e-41d9-a7cf-bcda0d695b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.742059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bd8eb-3a2e-41d9-a7cf-bcda0d695b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.742334 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bd8eb-3a2e-41d9-a7cf-bcda0d695b40 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.743068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bd8eb-3a2e-41d9-a7cf-bcda0d695b40 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.744519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-6dc39d36-7e5d-435c-adb0-e23cb9295553 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:13:25.744675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bd8eb-3a2e-41d9-a7cf-bcda0d695b40 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.746057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 409/808] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:25.752454 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39d36-7e5d-435c-adb0-e23cb9295553 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.756816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-143bd8eb-3a2e-41d9-a7cf-bcda0d695b40 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:13:25.759358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 400/809] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:25.763681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39d36-7e5d-435c-adb0-e23cb9295553 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.769406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bd8eb-3a2e-41d9-a7cf-bcda0d695b40 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.777513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec373-28a2-4bfc-bd10-e3b18053b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.777513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec373-28a2-4bfc-bd10-e3b18053b782 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.777513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec373-28a2-4bfc-bd10-e3b18053b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.777513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec373-28a2-4bfc-bd10-e3b18053b782 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.778139 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ec373-28a2-4bfc-bd10-e3b18053b782 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.778139 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ec373-28a2-4bfc-bd10-e3b18053b782 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.781259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ec373-28a2-4bfc-bd10-e3b18053b782 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.784436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bd8eb-3a2e-41d9-a7cf-bcda0d695b40 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.798523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de8adb-c862-43d5-bde3-cb590d78134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.799200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8adb-c862-43d5-bde3-cb590d78134f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.799533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8adb-c862-43d5-bde3-cb590d78134f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.799809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de8adb-c862-43d5-bde3-cb590d78134f admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.802979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de8adb-c862-43d5-bde3-cb590d78134f admin admin] RBAC: Adding query filter params (name=network) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.803294 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de8adb-c862-43d5-bde3-cb590d78134f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.806787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de8adb-c862-43d5-bde3-cb590d78134f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.811906 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 410/810] 10.222.0.16 () {56 vars in 1156 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:25.818273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 401/811] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.819428 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec373-28a2-4bfc-bd10-e3b18053b782 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.824390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de8adb-c862-43d5-bde3-cb590d78134f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.840606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec373-28a2-4bfc-bd10-e3b18053b782 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.841742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de8adb-c862-43d5-bde3-cb590d78134f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.850018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64933ae-7b8b-4559-b736-e3ef79cb9caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.850693 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64933ae-7b8b-4559-b736-e3ef79cb9caa admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.851087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42ee2f-9382-4b79-b8bc-652b6125c84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.851877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ee2f-9382-4b79-b8bc-652b6125c84b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.852153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ee2f-9382-4b79-b8bc-652b6125c84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.852521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64933ae-7b8b-4559-b736-e3ef79cb9caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.852794 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64933ae-7b8b-4559-b736-e3ef79cb9caa admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.853464 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42ee2f-9382-4b79-b8bc-652b6125c84b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.853561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64933ae-7b8b-4559-b736-e3ef79cb9caa admin admin] RBAC: Adding query filter params (type=network) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.853840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64933ae-7b8b-4559-b736-e3ef79cb9caa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.855782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64933ae-7b8b-4559-b736-e3ef79cb9caa admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.864260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 402/812] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.867536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42ee2f-9382-4b79-b8bc-652b6125c84b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.869520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42ee2f-9382-4b79-b8bc-652b6125c84b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.871462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64933ae-7b8b-4559-b736-e3ef79cb9caa admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.883762 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64933ae-7b8b-4559-b736-e3ef79cb9caa admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.888526 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-7c42ee2f-9382-4b79-b8bc-652b6125c84b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:25.889067 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 411/813] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:25.892014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f94af-2bc8-4fb6-a356-c0e488ae513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.893050 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f94af-2bc8-4fb6-a356-c0e488ae513a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.893671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f94af-2bc8-4fb6-a356-c0e488ae513a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.894155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f94af-2bc8-4fb6-a356-c0e488ae513a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.894625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42ee2f-9382-4b79-b8bc-652b6125c84b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.895389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f94af-2bc8-4fb6-a356-c0e488ae513a admin admin] RBAC: Adding query filter params (interface=public, service_id=eca91a7f46fd4ecd92f0d2961b737a15, region_id=RegionOne) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.895994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f94af-2bc8-4fb6-a356-c0e488ae513a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.897313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-df4f94af-2bc8-4fb6-a356-c0e488ae513a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:25.897313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:13:25.897313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:13:25.898612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f94af-2bc8-4fb6-a356-c0e488ae513a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.905111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42ee2f-9382-4b79-b8bc-652b6125c84b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.909565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 403/814] 10.222.0.16 () {56 vars in 1272 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/endpoints?service_id=eca91a7f46fd4ecd92f0d2961b737a15&interface=public®ion_id=RegionOne => generated 194 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:25.910437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e5976-066f-46f3-a9a5-692fdb0de063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.911145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e5976-066f-46f3-a9a5-692fdb0de063 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.911418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e5976-066f-46f3-a9a5-692fdb0de063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.911685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e5976-066f-46f3-a9a5-692fdb0de063 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.912417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e5976-066f-46f3-a9a5-692fdb0de063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:25.912722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e5976-066f-46f3-a9a5-692fdb0de063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.914373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e5976-066f-46f3-a9a5-692fdb0de063 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.915211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f94af-2bc8-4fb6-a356-c0e488ae513a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.926388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f94af-2bc8-4fb6-a356-c0e488ae513a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.931157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b5ba4-0cb5-44b1-8af5-dbf88b1a19d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.931810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5ba4-0cb5-44b1-8af5-dbf88b1a19d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.932091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5ba4-0cb5-44b1-8af5-dbf88b1a19d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.932347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b5ba4-0cb5-44b1-8af5-dbf88b1a19d1 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.933032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b5ba4-0cb5-44b1-8af5-dbf88b1a19d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.934288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 412/815] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.938388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b5ba4-0cb5-44b1-8af5-dbf88b1a19d1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.942468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e5976-066f-46f3-a9a5-692fdb0de063 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:25.953005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 404/816] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/services => generated 772 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:25.956900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e5976-066f-46f3-a9a5-692fdb0de063 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:25.962119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752bce9-a752-4b17-8674-2e9bee66f1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:25.963252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752bce9-a752-4b17-8674-2e9bee66f1ad admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:25.963745 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752bce9-a752-4b17-8674-2e9bee66f1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:25.964221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752bce9-a752-4b17-8674-2e9bee66f1ad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:25.973417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752bce9-a752-4b17-8674-2e9bee66f1ad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:25.975711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752bce9-a752-4b17-8674-2e9bee66f1ad admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:25.991061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-e752bce9-a752-4b17-8674-2e9bee66f1ad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:25.992784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 413/817] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:25.999181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b5ba4-0cb5-44b1-8af5-dbf88b1a19d1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:26.010534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b5ba4-0cb5-44b1-8af5-dbf88b1a19d1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:26.020772 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e5b8-21a4-4c4d-8203-997ed6368007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:26.021847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e5b8-21a4-4c4d-8203-997ed6368007 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:26.022353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e5b8-21a4-4c4d-8203-997ed6368007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:26.022883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e5b8-21a4-4c4d-8203-997ed6368007 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:26.023907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86e5b8-21a4-4c4d-8203-997ed6368007 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:26.024434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86e5b8-21a4-4c4d-8203-997ed6368007 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:26.030649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86e5b8-21a4-4c4d-8203-997ed6368007 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:26.045171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 405/818] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:26.054373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752bce9-a752-4b17-8674-2e9bee66f1ad admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:26.065170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752bce9-a752-4b17-8674-2e9bee66f1ad admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:26.072876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b6239-0d17-4198-ab52-0851ef569965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:26.074085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b6239-0d17-4198-ab52-0851ef569965 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:26.074610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b6239-0d17-4198-ab52-0851ef569965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:26.075062 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b6239-0d17-4198-ab52-0851ef569965 admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/ca65456d336b4c3898831af80e6435a6/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:26.077354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b6239-0d17-4198-ab52-0851ef569965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=ca65456d336b4c3898831af80e6435a6, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:26.080364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b6239-0d17-4198-ab52-0851ef569965 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:26.103893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 414/819] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:26 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/ca65456d336b4c3898831af80e6435a6/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:27.062286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848866f9-c22d-4f41-8022-90d6a6ac112c None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:27.062836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848866f9-c22d-4f41-8022-90d6a6ac112c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:27.062836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848866f9-c22d-4f41-8022-90d6a6ac112c None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:27.065066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 406/820] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:27.070429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596f3f-8084-4883-ba8b-56be4944a99e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:27.070828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596f3f-8084-4883-ba8b-56be4944a99e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:27.071053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596f3f-8084-4883-ba8b-56be4944a99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:27.101754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-75596f3f-8084-4883-ba8b-56be4944a99e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:27.102954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-75596f3f-8084-4883-ba8b-56be4944a99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:27.177304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 415/821] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:27 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:27.220694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848866f9-c22d-4f41-8022-90d6a6ac112c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:27.236588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848866f9-c22d-4f41-8022-90d6a6ac112c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:27.246790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cd6c1-4df8-4670-851f-cb044a87a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:27.247590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cd6c1-4df8-4670-851f-cb044a87a410 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:27.247868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cd6c1-4df8-4670-851f-cb044a87a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:27.248139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cd6c1-4df8-4670-851f-cb044a87a410 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:27.248807 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cd6c1-4df8-4670-851f-cb044a87a410 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:27.250445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cd6c1-4df8-4670-851f-cb044a87a410 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:27.267297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0b4cd6c1-4df8-4670-851f-cb044a87a410 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 28 01:13:27.268493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 407/822] 10.222.0.16 () {56 vars in 1150 bytes} [Fri Jan 28 01:13:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:27.274717 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596f3f-8084-4883-ba8b-56be4944a99e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:27.283972 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596f3f-8084-4883-ba8b-56be4944a99e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:27.291160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475493ec-86b6-4329-bc4f-0741377f100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:27.291826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475493ec-86b6-4329-bc4f-0741377f100a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:27.292107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475493ec-86b6-4329-bc4f-0741377f100a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:27.292377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475493ec-86b6-4329-bc4f-0741377f100a admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:27.293170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475493ec-86b6-4329-bc4f-0741377f100a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:27.293629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475493ec-86b6-4329-bc4f-0741377f100a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:27.295238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475493ec-86b6-4329-bc4f-0741377f100a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:27.305169 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 416/823] 10.222.0.16 () {56 vars in 1145 bytes} [Fri Jan 28 01:13:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:27.311136 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cd6c1-4df8-4670-851f-cb044a87a410 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:27.326444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cd6c1-4df8-4670-851f-cb044a87a410 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:27.332150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f773a4f-40d8-4284-be32-5efc3419e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:27.332806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f773a4f-40d8-4284-be32-5efc3419e6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:27.333110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f773a4f-40d8-4284-be32-5efc3419e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:27.333445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f773a4f-40d8-4284-be32-5efc3419e6c6 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:27.334205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f773a4f-40d8-4284-be32-5efc3419e6c6 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:27.334524 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f773a4f-40d8-4284-be32-5efc3419e6c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:27.336109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f773a4f-40d8-4284-be32-5efc3419e6c6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:27.345609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 408/824] 10.222.0.16 () {56 vars in 1145 bytes} [Fri Jan 28 01:13:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:27.351945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475493ec-86b6-4329-bc4f-0741377f100a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:27.366230 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475493ec-86b6-4329-bc4f-0741377f100a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:27.372427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e042-c07e-4c2a-97f0-1fc814284f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:27.373091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e042-c07e-4c2a-97f0-1fc814284f08 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:27.373409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e042-c07e-4c2a-97f0-1fc814284f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:27.373681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e042-c07e-4c2a-97f0-1fc814284f08 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:27.374439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23e042-c07e-4c2a-97f0-1fc814284f08 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:27.375476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-3f23e042-c07e-4c2a-97f0-1fc814284f08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:27.375476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:13:27.375476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:13:27.376356 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23e042-c07e-4c2a-97f0-1fc814284f08 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:27.412135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 417/825] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Jan 28 01:13:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:28.198542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d186749-8bbe-4a5a-b15d-cb4a6cea50c0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.199117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d186749-8bbe-4a5a-b15d-cb4a6cea50c0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.199117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d186749-8bbe-4a5a-b15d-cb4a6cea50c0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.201258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 409/826] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:28.206562 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31694-77f7-461e-b0c9-37e4f55f07f3 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.207399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31694-77f7-461e-b0c9-37e4f55f07f3 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.207872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31694-77f7-461e-b0c9-37e4f55f07f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.219878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460528d6-ec2d-442d-8f01-1ac1abedcc42 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.220158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460528d6-ec2d-442d-8f01-1ac1abedcc42 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.220427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460528d6-ec2d-442d-8f01-1ac1abedcc42 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.222842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 410/827] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:28.227577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253f11-693c-4966-aa06-fac37e3ea4d1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.227856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253f11-693c-4966-aa06-fac37e3ea4d1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.228129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e253f11-693c-4966-aa06-fac37e3ea4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.228823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-40e31694-77f7-461e-b0c9-37e4f55f07f3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:28.230451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-40e31694-77f7-461e-b0c9-37e4f55f07f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:28.253644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 418/828] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:28 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:28.257340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4e253f11-693c-4966-aa06-fac37e3ea4d1 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:28.258743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4e253f11-693c-4966-aa06-fac37e3ea4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:28.266959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 411/829] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:28 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:28.291098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e31694-77f7-461e-b0c9-37e4f55f07f3 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.291604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253f11-693c-4966-aa06-fac37e3ea4d1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.301374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e253f11-693c-4966-aa06-fac37e3ea4d1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.303258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e31694-77f7-461e-b0c9-37e4f55f07f3 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.311195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d82f2-f8cf-41db-a805-b0b9f8f764f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.312015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d82f2-f8cf-41db-a805-b0b9f8f764f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.312300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d82f2-f8cf-41db-a805-b0b9f8f764f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.312572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d82f2-f8cf-41db-a805-b0b9f8f764f6 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.314198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d82f2-f8cf-41db-a805-b0b9f8f764f6 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.315811 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d82f2-f8cf-41db-a805-b0b9f8f764f6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.317722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1f23-3b75-478b-93bd-4392447aee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.318520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1f23-3b75-478b-93bd-4392447aee1d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.318795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1f23-3b75-478b-93bd-4392447aee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.319060 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1f23-3b75-478b-93bd-4392447aee1d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.334779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-104d82f2-f8cf-41db-a805-b0b9f8f764f6 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:13:28.339320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 412/830] 10.222.0.16 () {56 vars in 1153 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:28.344052 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d82f2-f8cf-41db-a805-b0b9f8f764f6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.345312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1f23-3b75-478b-93bd-4392447aee1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:28.353117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-830b1f23-3b75-478b-93bd-4392447aee1d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:13:28.354362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 419/831] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:28.364405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d82f2-f8cf-41db-a805-b0b9f8f764f6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.366314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1f23-3b75-478b-93bd-4392447aee1d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.368976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22247680-8b9f-4914-bb0d-de2fbb11467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.369660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22247680-8b9f-4914-bb0d-de2fbb11467f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.369946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22247680-8b9f-4914-bb0d-de2fbb11467f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.370215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22247680-8b9f-4914-bb0d-de2fbb11467f admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.371009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22247680-8b9f-4914-bb0d-de2fbb11467f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:28.371307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22247680-8b9f-4914-bb0d-de2fbb11467f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.372890 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22247680-8b9f-4914-bb0d-de2fbb11467f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.378062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 413/832] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:28.382357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1f23-3b75-478b-93bd-4392447aee1d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.388779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22247680-8b9f-4914-bb0d-de2fbb11467f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.395193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab599e9e-8b16-4b59-b0a3-aab979549173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.395868 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab599e9e-8b16-4b59-b0a3-aab979549173 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.396149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab599e9e-8b16-4b59-b0a3-aab979549173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.396418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab599e9e-8b16-4b59-b0a3-aab979549173 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.397189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab599e9e-8b16-4b59-b0a3-aab979549173 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:28.397524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab599e9e-8b16-4b59-b0a3-aab979549173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.399145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab599e9e-8b16-4b59-b0a3-aab979549173 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.399834 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22247680-8b9f-4914-bb0d-de2fbb11467f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.404717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2897bde-9d08-47c7-a6ef-79d0ba3d8c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.405612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2897bde-9d08-47c7-a6ef-79d0ba3d8c7e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.406103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2897bde-9d08-47c7-a6ef-79d0ba3d8c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.406562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2897bde-9d08-47c7-a6ef-79d0ba3d8c7e admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.407470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2897bde-9d08-47c7-a6ef-79d0ba3d8c7e admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:28.407964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2897bde-9d08-47c7-a6ef-79d0ba3d8c7e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.409756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2897bde-9d08-47c7-a6ef-79d0ba3d8c7e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.416012 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 414/833] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:28.428183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 420/834] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:28.434212 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2897bde-9d08-47c7-a6ef-79d0ba3d8c7e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.451507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2897bde-9d08-47c7-a6ef-79d0ba3d8c7e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.461572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793434d-e9c8-4a69-b89b-3721124e1eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.462872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793434d-e9c8-4a69-b89b-3721124e1eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.463418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793434d-e9c8-4a69-b89b-3721124e1eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.463901 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793434d-e9c8-4a69-b89b-3721124e1eb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.486058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793434d-e9c8-4a69-b89b-3721124e1eb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.488373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793434d-e9c8-4a69-b89b-3721124e1eb6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.509715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-8793434d-e9c8-4a69-b89b-3721124e1eb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:28.516562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 415/835] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:28.517347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab599e9e-8b16-4b59-b0a3-aab979549173 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.536350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab599e9e-8b16-4b59-b0a3-aab979549173 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.547645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06879674-b102-48b8-95b3-c60f97e86707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.548334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06879674-b102-48b8-95b3-c60f97e86707 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.548660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06879674-b102-48b8-95b3-c60f97e86707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.548937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06879674-b102-48b8-95b3-c60f97e86707 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.549728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06879674-b102-48b8-95b3-c60f97e86707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:28.550087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06879674-b102-48b8-95b3-c60f97e86707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.551787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06879674-b102-48b8-95b3-c60f97e86707 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.571033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 421/836] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:28.576965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793434d-e9c8-4a69-b89b-3721124e1eb6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.590664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793434d-e9c8-4a69-b89b-3721124e1eb6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.601797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d922f92-0f72-4eb1-b484-cbc458afcf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.602681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d922f92-0f72-4eb1-b484-cbc458afcf16 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.602962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d922f92-0f72-4eb1-b484-cbc458afcf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.603283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d922f92-0f72-4eb1-b484-cbc458afcf16 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.618366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d922f92-0f72-4eb1-b484-cbc458afcf16 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.620483 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d922f92-0f72-4eb1-b484-cbc458afcf16 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.643745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-4d922f92-0f72-4eb1-b484-cbc458afcf16 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:13:28.644995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 416/837] 10.222.0.16 () {56 vars in 1138 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:28.650993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06879674-b102-48b8-95b3-c60f97e86707 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.666730 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06879674-b102-48b8-95b3-c60f97e86707 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.672810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c0d31-7d05-4578-9b14-c87827e5f664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.673611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0d31-7d05-4578-9b14-c87827e5f664 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.673958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0d31-7d05-4578-9b14-c87827e5f664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.674297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0d31-7d05-4578-9b14-c87827e5f664 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.675223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c0d31-7d05-4578-9b14-c87827e5f664 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:28.675527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c0d31-7d05-4578-9b14-c87827e5f664 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.677469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c0d31-7d05-4578-9b14-c87827e5f664 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.706278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 422/838] 10.222.0.16 () {56 vars in 1170 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:28.708869 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48a5cb-d7cf-4c11-ba93-8bfd7c9cdaaa None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.709152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48a5cb-d7cf-4c11-ba93-8bfd7c9cdaaa None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.709453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48a5cb-d7cf-4c11-ba93-8bfd7c9cdaaa None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.711323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 417/839] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:28.712148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c0d31-7d05-4578-9b14-c87827e5f664 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.716851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b1d98-cc3c-43b3-bea2-056e03a21b0c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.717400 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b1d98-cc3c-43b3-bea2-056e03a21b0c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.717895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b1d98-cc3c-43b3-bea2-056e03a21b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.726269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c0d31-7d05-4578-9b14-c87827e5f664 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.731816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72740fc1-c1ab-49f6-8891-7fe98dd7d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.732469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740fc1-c1ab-49f6-8891-7fe98dd7d205 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.732803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740fc1-c1ab-49f6-8891-7fe98dd7d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.733083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740fc1-c1ab-49f6-8891-7fe98dd7d205 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.740419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-cc1b1d98-cc3c-43b3-bea2-056e03a21b0c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:28.742016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72740fc1-c1ab-49f6-8891-7fe98dd7d205 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.742408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-cc1b1d98-cc3c-43b3-bea2-056e03a21b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:28.743840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72740fc1-c1ab-49f6-8891-7fe98dd7d205 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.752415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 418/840] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:28 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:28.757289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 423/841] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/auth/tokens => generated 1303 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:13:28.759714 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b1d98-cc3c-43b3-bea2-056e03a21b0c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.769775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b1d98-cc3c-43b3-bea2-056e03a21b0c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.775372 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fdc48-f102-4051-b772-bc6eb14b39c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.776397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fdc48-f102-4051-b772-bc6eb14b39c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.777684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72740fc1-c1ab-49f6-8891-7fe98dd7d205 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.781723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fdc48-f102-4051-b772-bc6eb14b39c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.782100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fdc48-f102-4051-b772-bc6eb14b39c9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.788439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72740fc1-c1ab-49f6-8891-7fe98dd7d205 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.796874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d1b1f-db99-448d-86d9-44cf6b74fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.797961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d1b1f-db99-448d-86d9-44cf6b74fba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.798248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d1b1f-db99-448d-86d9-44cf6b74fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.798521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d1b1f-db99-448d-86d9-44cf6b74fba7 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.799193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d1b1f-db99-448d-86d9-44cf6b74fba7 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.800229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-e17d1b1f-db99-448d-86d9-44cf6b74fba7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:28.800229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:13:28.800229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:13:28.801611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d1b1f-db99-448d-86d9-44cf6b74fba7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.802714 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fdc48-f102-4051-b772-bc6eb14b39c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.804745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fdc48-f102-4051-b772-bc6eb14b39c9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.817494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-e17d1b1f-db99-448d-86d9-44cf6b74fba7 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 28 01:13:28.819068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 424/842] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:28.820318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1a02d-2069-413f-aacf-2d1f76681482 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.825265 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1a02d-2069-413f-aacf-2d1f76681482 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.825265 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1a02d-2069-413f-aacf-2d1f76681482 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.827009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 425/843] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:28.828629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20f19-968b-4ff8-b838-70e9588080ee None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.829114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20f19-968b-4ff8-b838-70e9588080ee None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.829423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20f19-968b-4ff8-b838-70e9588080ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.829962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-952fdc48-f102-4051-b772-bc6eb14b39c9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:28.831627 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 419/844] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:28.832898 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fdc48-f102-4051-b772-bc6eb14b39c9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.843167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fdc48-f102-4051-b772-bc6eb14b39c9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.848274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917c77a-9e6f-4390-a199-e6ec8677d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.849093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-57d20f19-968b-4ff8-b838-70e9588080ee None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:28.849374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917c77a-9e6f-4390-a199-e6ec8677d580 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.849822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917c77a-9e6f-4390-a199-e6ec8677d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.850219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917c77a-9e6f-4390-a199-e6ec8677d580 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.850324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-57d20f19-968b-4ff8-b838-70e9588080ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:28.851181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917c77a-9e6f-4390-a199-e6ec8677d580 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:28.851640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917c77a-9e6f-4390-a199-e6ec8677d580 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.853429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917c77a-9e6f-4390-a199-e6ec8677d580 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.859092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 420/846] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:28.860055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917c77a-9e6f-4390-a199-e6ec8677d580 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.864433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 426/846] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:28 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:28.865587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d20f19-968b-4ff8-b838-70e9588080ee None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.875011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917c77a-9e6f-4390-a199-e6ec8677d580 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.880055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbcb7a-74c9-4ba0-b3d1-66fede931b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.880189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d20f19-968b-4ff8-b838-70e9588080ee None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.881021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbcb7a-74c9-4ba0-b3d1-66fede931b89 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.881556 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbcb7a-74c9-4ba0-b3d1-66fede931b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.881960 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbcb7a-74c9-4ba0-b3d1-66fede931b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.882861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbcb7a-74c9-4ba0-b3d1-66fede931b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:28.883314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbcb7a-74c9-4ba0-b3d1-66fede931b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.885100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbcb7a-74c9-4ba0-b3d1-66fede931b89 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.890537 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98480b95-9732-482b-bcfe-178968bd144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.891323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98480b95-9732-482b-bcfe-178968bd144d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.891609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98480b95-9732-482b-bcfe-178968bd144d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.891886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98480b95-9732-482b-bcfe-178968bd144d admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.892618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98480b95-9732-482b-bcfe-178968bd144d admin admin] RBAC: Adding query filter params (type=network) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:28.892922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98480b95-9732-482b-bcfe-178968bd144d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.894687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98480b95-9732-482b-bcfe-178968bd144d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.899622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 421/847] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:28.904535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 427/848] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:28.905323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98480b95-9732-482b-bcfe-178968bd144d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.906257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbcb7a-74c9-4ba0-b3d1-66fede931b89 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.915644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98480b95-9732-482b-bcfe-178968bd144d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.916310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbcb7a-74c9-4ba0-b3d1-66fede931b89 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.920823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2768d3c-956b-48fa-9609-4f4214b571db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.921400 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95142e-a46a-4329-b283-4dd44351a2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.921722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768d3c-956b-48fa-9609-4f4214b571db admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.922006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768d3c-956b-48fa-9609-4f4214b571db admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.922280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2768d3c-956b-48fa-9609-4f4214b571db admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.923015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95142e-a46a-4329-b283-4dd44351a2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.923436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95142e-a46a-4329-b283-4dd44351a2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.923837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95142e-a46a-4329-b283-4dd44351a2d6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.930569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2768d3c-956b-48fa-9609-4f4214b571db admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.932643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2768d3c-956b-48fa-9609-4f4214b571db admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.936133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95142e-a46a-4329-b283-4dd44351a2d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:28.943121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-4e95142e-a46a-4329-b283-4dd44351a2d6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:13:28.944843 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 422/849] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:28.945744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95142e-a46a-4329-b283-4dd44351a2d6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.951483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-f2768d3c-956b-48fa-9609-4f4214b571db admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:28.953318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 428/850] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:28.954378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2768d3c-956b-48fa-9609-4f4214b571db admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.956274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95142e-a46a-4329-b283-4dd44351a2d6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.961152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c498e3-782d-48b2-bcfb-4b82dcaf7f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.962024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c498e3-782d-48b2-bcfb-4b82dcaf7f24 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.962471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c498e3-782d-48b2-bcfb-4b82dcaf7f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.962896 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c498e3-782d-48b2-bcfb-4b82dcaf7f24 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.963829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c498e3-782d-48b2-bcfb-4b82dcaf7f24 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.965138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-19c498e3-782d-48b2-bcfb-4b82dcaf7f24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:13:28.965138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:13:28.965138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:13:28.966170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2768d3c-956b-48fa-9609-4f4214b571db admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:28.966497 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c498e3-782d-48b2-bcfb-4b82dcaf7f24 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.971215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3db01f-8d82-40e8-8606-659f67880315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:28.971961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3db01f-8d82-40e8-8606-659f67880315 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:28.972697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3db01f-8d82-40e8-8606-659f67880315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:28.973066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3db01f-8d82-40e8-8606-659f67880315 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:28.973960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3db01f-8d82-40e8-8606-659f67880315 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:28.974362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3db01f-8d82-40e8-8606-659f67880315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:28.976180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3db01f-8d82-40e8-8606-659f67880315 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:28.990725 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 429/851] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:28.991984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3db01f-8d82-40e8-8606-659f67880315 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:28.996158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 423/852] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Jan 28 01:13:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:29.003028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3db01f-8d82-40e8-8606-659f67880315 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.003835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c498e3-782d-48b2-bcfb-4b82dcaf7f24 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.021276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecc22e-6cdc-4cd9-ab1f-32491d42c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.021276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecc22e-6cdc-4cd9-ab1f-32491d42c6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.021276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecc22e-6cdc-4cd9-ab1f-32491d42c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.021276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecc22e-6cdc-4cd9-ab1f-32491d42c6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.021744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecc22e-6cdc-4cd9-ab1f-32491d42c6ec admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:29.021744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecc22e-6cdc-4cd9-ab1f-32491d42c6ec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.022530 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecc22e-6cdc-4cd9-ab1f-32491d42c6ec admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.023554 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c498e3-782d-48b2-bcfb-4b82dcaf7f24 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.038597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 430/853] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:29.039581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778b92c-832c-429d-bf4d-ba9f631aaaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.040393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b92c-832c-429d-bf4d-ba9f631aaaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.040672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b92c-832c-429d-bf4d-ba9f631aaaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.040940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b92c-832c-429d-bf4d-ba9f631aaaf4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.044730 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecc22e-6cdc-4cd9-ab1f-32491d42c6ec admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.055700 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecc22e-6cdc-4cd9-ab1f-32491d42c6ec admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.060919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1036e-b413-44e2-ad6e-458e6c613bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.061848 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1036e-b413-44e2-ad6e-458e6c613bfb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.062349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1036e-b413-44e2-ad6e-458e6c613bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.062789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1036e-b413-44e2-ad6e-458e6c613bfb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.063915 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1036e-b413-44e2-ad6e-458e6c613bfb admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=b3b098dc0f2f465f947df6e136b33f68) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:29.064405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1036e-b413-44e2-ad6e-458e6c613bfb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.066657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1036e-b413-44e2-ad6e-458e6c613bfb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.074169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778b92c-832c-429d-bf4d-ba9f631aaaf4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.074418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 431/854] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:29 2022] GET /identity/v3/role_assignments?user.id=b3b098dc0f2f465f947df6e136b33f68&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:29.079666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778b92c-832c-429d-bf4d-ba9f631aaaf4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.116348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-d778b92c-832c-429d-bf4d-ba9f631aaaf4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:29.129860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 424/855] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:29.135987 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1036e-b413-44e2-ad6e-458e6c613bfb admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.156268 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1036e-b413-44e2-ad6e-458e6c613bfb admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.161470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950cb53-5769-4aa8-b18e-0f99e4ae9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.162547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cb53-5769-4aa8-b18e-0f99e4ae9cff admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.163100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cb53-5769-4aa8-b18e-0f99e4ae9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.163567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950cb53-5769-4aa8-b18e-0f99e4ae9cff admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.164556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950cb53-5769-4aa8-b18e-0f99e4ae9cff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:29.165058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950cb53-5769-4aa8-b18e-0f99e4ae9cff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.170384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950cb53-5769-4aa8-b18e-0f99e4ae9cff admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.191698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 432/856] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:29.197560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778b92c-832c-429d-bf4d-ba9f631aaaf4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.211465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778b92c-832c-429d-bf4d-ba9f631aaaf4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.228122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e00de-7efd-4c59-bbe0-59e4d8ef4cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.228933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e00de-7efd-4c59-bbe0-59e4d8ef4cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.229207 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e00de-7efd-4c59-bbe0-59e4d8ef4cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.229518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e00de-7efd-4c59-bbe0-59e4d8ef4cfc admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.241982 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e00de-7efd-4c59-bbe0-59e4d8ef4cfc admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.244005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e00de-7efd-4c59-bbe0-59e4d8ef4cfc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.273503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-9e3e00de-7efd-4c59-bbe0-59e4d8ef4cfc admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 28 01:13:29.274788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 425/857] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:29.283284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950cb53-5769-4aa8-b18e-0f99e4ae9cff admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.298877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950cb53-5769-4aa8-b18e-0f99e4ae9cff admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.306021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755b8d6-a94f-4cca-acef-7a8f1ac334b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.307107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755b8d6-a94f-4cca-acef-7a8f1ac334b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.307684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755b8d6-a94f-4cca-acef-7a8f1ac334b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.308099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755b8d6-a94f-4cca-acef-7a8f1ac334b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.309178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755b8d6-a94f-4cca-acef-7a8f1ac334b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:29.309665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755b8d6-a94f-4cca-acef-7a8f1ac334b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.311728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755b8d6-a94f-4cca-acef-7a8f1ac334b2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.335679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 433/858] 10.222.0.16 () {56 vars in 1156 bytes} [Fri Jan 28 01:13:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:29.341448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e00de-7efd-4c59-bbe0-59e4d8ef4cfc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.354140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e00de-7efd-4c59-bbe0-59e4d8ef4cfc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.361192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d27a4-390a-4f35-929a-cb879df8bc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.361925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d27a4-390a-4f35-929a-cb879df8bc53 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.362203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d27a4-390a-4f35-929a-cb879df8bc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.362467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d27a4-390a-4f35-929a-cb879df8bc53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.373093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d27a4-390a-4f35-929a-cb879df8bc53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.374891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d27a4-390a-4f35-929a-cb879df8bc53 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.387833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 426/859] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:29 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:13:29.394595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755b8d6-a94f-4cca-acef-7a8f1ac334b2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.407547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755b8d6-a94f-4cca-acef-7a8f1ac334b2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.414094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb5b74-fe90-478f-b015-efff1199ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.415240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb5b74-fe90-478f-b015-efff1199ab5f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.415716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb5b74-fe90-478f-b015-efff1199ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.416249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb5b74-fe90-478f-b015-efff1199ab5f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.429967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb5b74-fe90-478f-b015-efff1199ab5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.431762 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb5b74-fe90-478f-b015-efff1199ab5f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.449470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-05eb5b74-fe90-478f-b015-efff1199ab5f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:29.450731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 434/860] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:29.456498 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d27a4-390a-4f35-929a-cb879df8bc53 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.465704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d27a4-390a-4f35-929a-cb879df8bc53 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.470233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea683e-2722-4228-b144-f5c0c57361f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.470887 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea683e-2722-4228-b144-f5c0c57361f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.471165 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea683e-2722-4228-b144-f5c0c57361f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.471442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea683e-2722-4228-b144-f5c0c57361f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.472295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea683e-2722-4228-b144-f5c0c57361f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:29.472967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea683e-2722-4228-b144-f5c0c57361f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.474596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea683e-2722-4228-b144-f5c0c57361f5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.490549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 427/861] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:29.492905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb5b74-fe90-478f-b015-efff1199ab5f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.502984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb5b74-fe90-478f-b015-efff1199ab5f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.507621 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5083a9-c1d3-450d-bb00-fd577413d08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.508459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5083a9-c1d3-450d-bb00-fd577413d08b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.508735 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5083a9-c1d3-450d-bb00-fd577413d08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.509053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5083a9-c1d3-450d-bb00-fd577413d08b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.516301 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5083a9-c1d3-450d-bb00-fd577413d08b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.518320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5083a9-c1d3-450d-bb00-fd577413d08b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.531516 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-2d5083a9-c1d3-450d-bb00-fd577413d08b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:29.537168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 435/862] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:29.538892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea683e-2722-4228-b144-f5c0c57361f5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.548964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea683e-2722-4228-b144-f5c0c57361f5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.553741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8984744-d188-41f8-b919-fa5d1e0032b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.554447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8984744-d188-41f8-b919-fa5d1e0032b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.554729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8984744-d188-41f8-b919-fa5d1e0032b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.555000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8984744-d188-41f8-b919-fa5d1e0032b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.555858 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8984744-d188-41f8-b919-fa5d1e0032b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:29.556160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8984744-d188-41f8-b919-fa5d1e0032b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.558155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8984744-d188-41f8-b919-fa5d1e0032b1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.570456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 428/863] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:29.576610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5083a9-c1d3-450d-bb00-fd577413d08b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:29.587271 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5083a9-c1d3-450d-bb00-fd577413d08b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:29.591936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5677a5-6e5f-4c16-aeeb-6b73b97f035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:29.592620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5677a5-6e5f-4c16-aeeb-6b73b97f035e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:29.592900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5677a5-6e5f-4c16-aeeb-6b73b97f035e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:29.593169 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5677a5-6e5f-4c16-aeeb-6b73b97f035e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:29.594098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5677a5-6e5f-4c16-aeeb-6b73b97f035e admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=ca65456d336b4c3898831af80e6435a6) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:29.594404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5677a5-6e5f-4c16-aeeb-6b73b97f035e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:29.596358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5677a5-6e5f-4c16-aeeb-6b73b97f035e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:29.613615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 436/864] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:29 2022] GET /identity/v3/role_assignments?user.id=ca65456d336b4c3898831af80e6435a6&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:30.400130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded13a2-575a-4ad3-a659-da506a48aa79 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:30.400867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded13a2-575a-4ad3-a659-da506a48aa79 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:30.400867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded13a2-575a-4ad3-a659-da506a48aa79 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:30.402942 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 429/865] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:30.409014 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348fd85-4842-49b1-a58f-68cdd78d5e96 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:30.409675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348fd85-4842-49b1-a58f-68cdd78d5e96 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:30.409675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348fd85-4842-49b1-a58f-68cdd78d5e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:30.428609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4348fd85-4842-49b1-a58f-68cdd78d5e96 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:30.429831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4348fd85-4842-49b1-a58f-68cdd78d5e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:30.437856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 437/866] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:30 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:30.459885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded13a2-575a-4ad3-a659-da506a48aa79 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:30.472215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded13a2-575a-4ad3-a659-da506a48aa79 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:30.476929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66384c8-fbd6-4e6b-964f-b5bb140ff91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:30.477745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66384c8-fbd6-4e6b-964f-b5bb140ff91c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:30.478015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66384c8-fbd6-4e6b-964f-b5bb140ff91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:30.478279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66384c8-fbd6-4e6b-964f-b5bb140ff91c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:30.478942 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66384c8-fbd6-4e6b-964f-b5bb140ff91c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:30.480586 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66384c8-fbd6-4e6b-964f-b5bb140ff91c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:30.491675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c66384c8-fbd6-4e6b-964f-b5bb140ff91c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:13:30.493134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 430/867] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:13:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:30.499244 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348fd85-4842-49b1-a58f-68cdd78d5e96 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:30.508316 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348fd85-4842-49b1-a58f-68cdd78d5e96 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:30.512915 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd44d-045a-42f3-8936-c78c605de8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:30.513605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd44d-045a-42f3-8936-c78c605de8eb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:30.513879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd44d-045a-42f3-8936-c78c605de8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:30.514146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd44d-045a-42f3-8936-c78c605de8eb admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:30.514861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd44d-045a-42f3-8936-c78c605de8eb admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:30.515158 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd44d-045a-42f3-8936-c78c605de8eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:30.516748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd44d-045a-42f3-8936-c78c605de8eb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:30.521732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 438/868] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:13:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:30.527266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66384c8-fbd6-4e6b-964f-b5bb140ff91c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:30.536897 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66384c8-fbd6-4e6b-964f-b5bb140ff91c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:30.541356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fb5f8-b86a-4e70-b964-5e2c9fa9bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:30.541999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb5f8-b86a-4e70-b964-5e2c9fa9bdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:30.542276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb5f8-b86a-4e70-b964-5e2c9fa9bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:30.542546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb5f8-b86a-4e70-b964-5e2c9fa9bdd6 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:30.543306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fb5f8-b86a-4e70-b964-5e2c9fa9bdd6 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:30.543606 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fb5f8-b86a-4e70-b964-5e2c9fa9bdd6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:30.545183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fb5f8-b86a-4e70-b964-5e2c9fa9bdd6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:30.550213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 431/869] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:13:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:30.906981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724252ff-40c6-4876-bea1-e4b325d71ecb None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:30.907368 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724252ff-40c6-4876-bea1-e4b325d71ecb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:30.907555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724252ff-40c6-4876-bea1-e4b325d71ecb None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:30.909578 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 439/870] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:30.914860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0ceb0-5128-4707-9216-265986c509b3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:30.915153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0ceb0-5128-4707-9216-265986c509b3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:30.915431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0ceb0-5128-4707-9216-265986c509b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:30.933529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a2a0ceb0-5128-4707-9216-265986c509b3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:30.934853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a2a0ceb0-5128-4707-9216-265986c509b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:30.942898 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 432/871] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:30 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:30.966151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724252ff-40c6-4876-bea1-e4b325d71ecb None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:30.978638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724252ff-40c6-4876-bea1-e4b325d71ecb None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:30.983248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27cc7d-e513-4b1f-ad8f-9a01b37c9821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:30.983903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27cc7d-e513-4b1f-ad8f-9a01b37c9821 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:30.984180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27cc7d-e513-4b1f-ad8f-9a01b37c9821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:30.984453 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27cc7d-e513-4b1f-ad8f-9a01b37c9821 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:30.985191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27cc7d-e513-4b1f-ad8f-9a01b37c9821 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:30.986816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27cc7d-e513-4b1f-ad8f-9a01b37c9821 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:31.002814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 440/872] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:13:30 2022] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:31.521641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed5d46-bcb2-469f-9283-7a1dc61ce13a None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.522349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed5d46-bcb2-469f-9283-7a1dc61ce13a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.522349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed5d46-bcb2-469f-9283-7a1dc61ce13a None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.524249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 433/873] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:31.529851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca95499-3dbd-4656-bdbc-ff295e97d3b5 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.530400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca95499-3dbd-4656-bdbc-ff295e97d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.530400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca95499-3dbd-4656-bdbc-ff295e97d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.549644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-fca95499-3dbd-4656-bdbc-ff295e97d3b5 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:31.550833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-fca95499-3dbd-4656-bdbc-ff295e97d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:31.567187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 441/874] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:31 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:31.590801 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed5d46-bcb2-469f-9283-7a1dc61ce13a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:31.603623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed5d46-bcb2-469f-9283-7a1dc61ce13a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:31.608144 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902a103-00b4-4cb7-a386-43f66b923144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:31.614233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a103-00b4-4cb7-a386-43f66b923144 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.614518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a103-00b4-4cb7-a386-43f66b923144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.614799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a103-00b4-4cb7-a386-43f66b923144 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.630954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902a103-00b4-4cb7-a386-43f66b923144 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:31.638368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-4902a103-00b4-4cb7-a386-43f66b923144 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:13:31.644662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 434/875] 10.222.0.16 () {56 vars in 1141 bytes} [Fri Jan 28 01:13:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:31.646192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca95499-3dbd-4656-bdbc-ff295e97d3b5 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:31.656812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca95499-3dbd-4656-bdbc-ff295e97d3b5 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:31.661766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d9e64-d964-4091-aa0f-d7de6a61234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:31.662481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9e64-d964-4091-aa0f-d7de6a61234e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.662759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9e64-d964-4091-aa0f-d7de6a61234e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.663030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d9e64-d964-4091-aa0f-d7de6a61234e admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.663847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d9e64-d964-4091-aa0f-d7de6a61234e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:31.664151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d9e64-d964-4091-aa0f-d7de6a61234e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:31.665903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d9e64-d964-4091-aa0f-d7de6a61234e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:31.676643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 442/876] 10.222.0.16 () {56 vars in 1136 bytes} [Fri Jan 28 01:13:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:31.682313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902a103-00b4-4cb7-a386-43f66b923144 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:31.692886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902a103-00b4-4cb7-a386-43f66b923144 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:31.697820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a917-f84f-42f4-bf7e-7ed3a6d25472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:31.698860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a917-f84f-42f4-bf7e-7ed3a6d25472 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.699360 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a917-f84f-42f4-bf7e-7ed3a6d25472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.699805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a917-f84f-42f4-bf7e-7ed3a6d25472 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.711356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69a917-f84f-42f4-bf7e-7ed3a6d25472 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:31.713474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69a917-f84f-42f4-bf7e-7ed3a6d25472 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:31.730462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-cc69a917-f84f-42f4-bf7e-7ed3a6d25472 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:31.731906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 435/877] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:31.737836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d9e64-d964-4091-aa0f-d7de6a61234e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:31.752861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d9e64-d964-4091-aa0f-d7de6a61234e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:31.757969 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc935d36-69d8-403d-a888-5075d42783c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:31.758636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc935d36-69d8-403d-a888-5075d42783c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.758965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc935d36-69d8-403d-a888-5075d42783c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.759237 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc935d36-69d8-403d-a888-5075d42783c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.759978 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc935d36-69d8-403d-a888-5075d42783c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:31.761795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc935d36-69d8-403d-a888-5075d42783c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:31.762068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc935d36-69d8-403d-a888-5075d42783c2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:31.906817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 443/878] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:31.912824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a917-f84f-42f4-bf7e-7ed3a6d25472 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:31.913931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ef910-0ce2-42b2-8653-2eb22a238106 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.914217 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ef910-0ce2-42b2-8653-2eb22a238106 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.914498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ef910-0ce2-42b2-8653-2eb22a238106 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.916330 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 444/879] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:31.921255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52102c74-ac03-41c8-9298-5eb7f5f2162e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.921539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52102c74-ac03-41c8-9298-5eb7f5f2162e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.921809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52102c74-ac03-41c8-9298-5eb7f5f2162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.931718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a917-f84f-42f4-bf7e-7ed3a6d25472 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:31.937277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127c70-1cd7-4ea3-a30c-cbfc5afbdd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:31.938330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127c70-1cd7-4ea3-a30c-cbfc5afbdd94 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.938809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127c70-1cd7-4ea3-a30c-cbfc5afbdd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.939375 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5127c70-1cd7-4ea3-a30c-cbfc5afbdd94 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.940108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-52102c74-ac03-41c8-9298-5eb7f5f2162e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:31.941309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-52102c74-ac03-41c8-9298-5eb7f5f2162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:31.949545 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127c70-1cd7-4ea3-a30c-cbfc5afbdd94 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:31.951981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5127c70-1cd7-4ea3-a30c-cbfc5afbdd94 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:31.957304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 445/880] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:31 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:31.970237 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-f5127c70-1cd7-4ea3-a30c-cbfc5afbdd94 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:13:31.976629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 436/881] 10.222.0.16 () {56 vars in 1138 bytes} [Fri Jan 28 01:13:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:31.978076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52102c74-ac03-41c8-9298-5eb7f5f2162e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:31.978493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127c70-1cd7-4ea3-a30c-cbfc5afbdd94 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:31.987714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52102c74-ac03-41c8-9298-5eb7f5f2162e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:31.988434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5127c70-1cd7-4ea3-a30c-cbfc5afbdd94 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:31.993181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077cbe-a4eb-4554-bfcd-9b4d2555284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:31.993441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804dad8-4140-4381-b5e2-e5a27346dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:31.994110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077cbe-a4eb-4554-bfcd-9b4d2555284d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.994480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077cbe-a4eb-4554-bfcd-9b4d2555284d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.994686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804dad8-4140-4381-b5e2-e5a27346dc8d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:31.994962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077cbe-a4eb-4554-bfcd-9b4d2555284d admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.995265 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804dad8-4140-4381-b5e2-e5a27346dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:31.995682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804dad8-4140-4381-b5e2-e5a27346dc8d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:31.996223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077cbe-a4eb-4554-bfcd-9b4d2555284d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:31.996618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077cbe-a4eb-4554-bfcd-9b4d2555284d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:31.997036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804dad8-4140-4381-b5e2-e5a27346dc8d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:31.998754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077cbe-a4eb-4554-bfcd-9b4d2555284d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:31.999038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804dad8-4140-4381-b5e2-e5a27346dc8d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:32.010527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-2804dad8-4140-4381-b5e2-e5a27346dc8d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:13:32.012375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 446/882] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:32.017949 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804dad8-4140-4381-b5e2-e5a27346dc8d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:32.023525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 437/883] 10.222.0.16 () {56 vars in 1170 bytes} [Fri Jan 28 01:13:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:32.029478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804dad8-4140-4381-b5e2-e5a27346dc8d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:32.031490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077cbe-a4eb-4554-bfcd-9b4d2555284d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:32.034112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac1550-b144-4ae4-b74a-89cf76af7dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:32.034789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac1550-b144-4ae4-b74a-89cf76af7dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.035086 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac1550-b144-4ae4-b74a-89cf76af7dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.035574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac1550-b144-4ae4-b74a-89cf76af7dd4 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.036861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac1550-b144-4ae4-b74a-89cf76af7dd4 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:32.037181 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac1550-b144-4ae4-b74a-89cf76af7dd4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:32.038805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac1550-b144-4ae4-b74a-89cf76af7dd4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:32.049863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 447/884] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jan 28 01:13:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:32.050029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077cbe-a4eb-4554-bfcd-9b4d2555284d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:32.052037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac1550-b144-4ae4-b74a-89cf76af7dd4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:32.062007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47076ef-f303-4a6b-af6e-868e3f203823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:32.063013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47076ef-f303-4a6b-af6e-868e3f203823 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.063662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47076ef-f303-4a6b-af6e-868e3f203823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.064445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47076ef-f303-4a6b-af6e-868e3f203823 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.067559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac1550-b144-4ae4-b74a-89cf76af7dd4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:32.072433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06e7ee-d1af-4cef-8db8-8775b6804a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:32.073093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06e7ee-d1af-4cef-8db8-8775b6804a5a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.073406 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06e7ee-d1af-4cef-8db8-8775b6804a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.073681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06e7ee-d1af-4cef-8db8-8775b6804a5a admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.074450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06e7ee-d1af-4cef-8db8-8775b6804a5a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:32.074752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06e7ee-d1af-4cef-8db8-8775b6804a5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:32.076352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06e7ee-d1af-4cef-8db8-8775b6804a5a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:32.079093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47076ef-f303-4a6b-af6e-868e3f203823 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:32.081128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 448/885] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jan 28 01:13:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:32.086027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47076ef-f303-4a6b-af6e-868e3f203823 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:32.098618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 438/886] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:32 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:13:32.104682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06e7ee-d1af-4cef-8db8-8775b6804a5a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:32.115213 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06e7ee-d1af-4cef-8db8-8775b6804a5a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:32.120075 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dd501-311c-4cc0-b2c7-2456d08446dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:32.120976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dd501-311c-4cc0-b2c7-2456d08446dd admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.121286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dd501-311c-4cc0-b2c7-2456d08446dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.121566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dd501-311c-4cc0-b2c7-2456d08446dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.134704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dd501-311c-4cc0-b2c7-2456d08446dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:32.136666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6dd501-311c-4cc0-b2c7-2456d08446dd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:32.154966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-6d6dd501-311c-4cc0-b2c7-2456d08446dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:32.161283 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 449/887] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:32.162770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47076ef-f303-4a6b-af6e-868e3f203823 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:32.172332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47076ef-f303-4a6b-af6e-868e3f203823 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:32.177265 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310c62-55f0-4469-8333-98df01fe25b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:32.178007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310c62-55f0-4469-8333-98df01fe25b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.178292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310c62-55f0-4469-8333-98df01fe25b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.178567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310c62-55f0-4469-8333-98df01fe25b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.179334 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d310c62-55f0-4469-8333-98df01fe25b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:32.179638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d310c62-55f0-4469-8333-98df01fe25b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:32.181299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d310c62-55f0-4469-8333-98df01fe25b7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:32.198930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 439/888] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:32.200953 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dd501-311c-4cc0-b2c7-2456d08446dd admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:32.211929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dd501-311c-4cc0-b2c7-2456d08446dd admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:32.217082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74657f9-ca71-453c-8d18-1ad3e96d7bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:32.218010 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74657f9-ca71-453c-8d18-1ad3e96d7bfe admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.218289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74657f9-ca71-453c-8d18-1ad3e96d7bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.218616 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74657f9-ca71-453c-8d18-1ad3e96d7bfe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.227995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74657f9-ca71-453c-8d18-1ad3e96d7bfe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:32.230241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74657f9-ca71-453c-8d18-1ad3e96d7bfe admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:32.245659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-c74657f9-ca71-453c-8d18-1ad3e96d7bfe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:32.253437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 450/889] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:32.255288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310c62-55f0-4469-8333-98df01fe25b7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:32.266590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310c62-55f0-4469-8333-98df01fe25b7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:32.273560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673d172-0c0a-4d3e-90a1-ec978ba05fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:32.274297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673d172-0c0a-4d3e-90a1-ec978ba05fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.274642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673d172-0c0a-4d3e-90a1-ec978ba05fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.274926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673d172-0c0a-4d3e-90a1-ec978ba05fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.275861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673d172-0c0a-4d3e-90a1-ec978ba05fd3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:32.276191 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673d172-0c0a-4d3e-90a1-ec978ba05fd3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:32.278260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673d172-0c0a-4d3e-90a1-ec978ba05fd3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:32.293848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 440/890] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:32.297908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74657f9-ca71-453c-8d18-1ad3e96d7bfe admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:32.310743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74657f9-ca71-453c-8d18-1ad3e96d7bfe admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:32.315473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00396368-27db-4861-befd-6d2057d0cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:32.316186 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00396368-27db-4861-befd-6d2057d0cca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.316464 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00396368-27db-4861-befd-6d2057d0cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.316742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00396368-27db-4861-befd-6d2057d0cca5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.317805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00396368-27db-4861-befd-6d2057d0cca5 admin admin] RBAC: Adding query filter params (role.id=6c1451150c314b4b9938ad823b9a6512, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=b3b098dc0f2f465f947df6e136b33f68) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:32.318119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00396368-27db-4861-befd-6d2057d0cca5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:32.320033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00396368-27db-4861-befd-6d2057d0cca5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:32.326692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 451/891] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:32 2022] GET /identity/v3/role_assignments?user.id=b3b098dc0f2f465f947df6e136b33f68&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=6c1451150c314b4b9938ad823b9a6512 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:32.786991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeed49e-664c-4a94-95d4-ba1acd207f02 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.786991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeed49e-664c-4a94-95d4-ba1acd207f02 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.786991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeed49e-664c-4a94-95d4-ba1acd207f02 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.788223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 441/892] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:32.793932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa9cf6-b39c-4a03-ba31-3984c28ad7b6 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.794732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa9cf6-b39c-4a03-ba31-3984c28ad7b6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.795198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa9cf6-b39c-4a03-ba31-3984c28ad7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.813124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-32fa9cf6-b39c-4a03-ba31-3984c28ad7b6 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:32.815717 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-32fa9cf6-b39c-4a03-ba31-3984c28ad7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:32.823568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 452/893] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:32 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:32.846517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeed49e-664c-4a94-95d4-ba1acd207f02 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:32.859965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeed49e-664c-4a94-95d4-ba1acd207f02 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:32.864559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ee649-72d3-4d86-bb8f-7bfefc2b0e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:32.865515 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ee649-72d3-4d86-bb8f-7bfefc2b0e24 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:32.866003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ee649-72d3-4d86-bb8f-7bfefc2b0e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:32.866453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ee649-72d3-4d86-bb8f-7bfefc2b0e24 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:32.867382 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ee649-72d3-4d86-bb8f-7bfefc2b0e24 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:32.869139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ee649-72d3-4d86-bb8f-7bfefc2b0e24 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:32.886866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 442/894] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:13:32 2022] POST /identity/v3/services => generated 251 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:33.319823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fad44-699b-409a-b203-a9b32f602af2 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:33.320199 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fad44-699b-409a-b203-a9b32f602af2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:33.320371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fad44-699b-409a-b203-a9b32f602af2 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:33.322577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 453/895] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:33.328134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878225ee-b6f8-41d0-8b8c-6e9c0b8849bd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:33.328421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878225ee-b6f8-41d0-8b8c-6e9c0b8849bd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:33.328698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878225ee-b6f8-41d0-8b8c-6e9c0b8849bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:33.348118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-878225ee-b6f8-41d0-8b8c-6e9c0b8849bd None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:33.349324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-878225ee-b6f8-41d0-8b8c-6e9c0b8849bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:33.366747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 443/896] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:33 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:33.390247 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fad44-699b-409a-b203-a9b32f602af2 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:33.402945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fad44-699b-409a-b203-a9b32f602af2 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:33.407568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dd81d-3a05-49d8-a784-0d72029b4510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:33.408623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dd81d-3a05-49d8-a784-0d72029b4510 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:33.409098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dd81d-3a05-49d8-a784-0d72029b4510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:33.409620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dd81d-3a05-49d8-a784-0d72029b4510 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:33.410481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dd81d-3a05-49d8-a784-0d72029b4510 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:33.412473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dd81d-3a05-49d8-a784-0d72029b4510 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:33.424002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-eb2dd81d-3a05-49d8-a784-0d72029b4510 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:13:33.425692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 454/897] 10.222.0.16 () {56 vars in 1153 bytes} [Fri Jan 28 01:13:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:33.431734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878225ee-b6f8-41d0-8b8c-6e9c0b8849bd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:33.441281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878225ee-b6f8-41d0-8b8c-6e9c0b8849bd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:33.446124 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795dd9e-3b46-4460-9629-62bfa7fc53ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:33.447016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795dd9e-3b46-4460-9629-62bfa7fc53ea admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:33.447492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795dd9e-3b46-4460-9629-62bfa7fc53ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:33.447969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795dd9e-3b46-4460-9629-62bfa7fc53ea admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:33.448920 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795dd9e-3b46-4460-9629-62bfa7fc53ea admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:33.449479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795dd9e-3b46-4460-9629-62bfa7fc53ea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:33.451304 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795dd9e-3b46-4460-9629-62bfa7fc53ea admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:33.457137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 444/898] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:33.463452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dd81d-3a05-49d8-a784-0d72029b4510 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:33.474484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dd81d-3a05-49d8-a784-0d72029b4510 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:33.479681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d68b-74dc-4a1c-a924-3f264c8c213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:33.480633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d68b-74dc-4a1c-a924-3f264c8c213c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:33.481183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d68b-74dc-4a1c-a924-3f264c8c213c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:33.481712 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038d68b-74dc-4a1c-a924-3f264c8c213c admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:33.482644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d68b-74dc-4a1c-a924-3f264c8c213c admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:33.483141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d68b-74dc-4a1c-a924-3f264c8c213c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:33.484932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038d68b-74dc-4a1c-a924-3f264c8c213c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:33.490679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 455/899] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:33.496900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795dd9e-3b46-4460-9629-62bfa7fc53ea admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:33.507457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795dd9e-3b46-4460-9629-62bfa7fc53ea admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:33.512571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89f1ab-a5fd-433d-a01e-0417e18551eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:33.513477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89f1ab-a5fd-433d-a01e-0417e18551eb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:33.513955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89f1ab-a5fd-433d-a01e-0417e18551eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:33.514444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89f1ab-a5fd-433d-a01e-0417e18551eb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:33.515438 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89f1ab-a5fd-433d-a01e-0417e18551eb admin admin] RBAC: Adding query filter params (interface=public, service_id=2e930fdda4a74d3a8998b92df5eff7c1, region_id=RegionOne) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:33.515960 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89f1ab-a5fd-433d-a01e-0417e18551eb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:33.517776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89f1ab-a5fd-433d-a01e-0417e18551eb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:33.523454 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 445/900] 10.222.0.16 () {56 vars in 1272 bytes} [Fri Jan 28 01:13:33 2022] GET /identity/v3/endpoints?service_id=2e930fdda4a74d3a8998b92df5eff7c1&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:33.529472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d68b-74dc-4a1c-a924-3f264c8c213c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:33.539814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038d68b-74dc-4a1c-a924-3f264c8c213c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:33.550536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602536a3-8a43-4c34-86f4-fc646f7b2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:33.551490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602536a3-8a43-4c34-86f4-fc646f7b2d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:33.552113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602536a3-8a43-4c34-86f4-fc646f7b2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:33.552601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602536a3-8a43-4c34-86f4-fc646f7b2d75 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:33.553574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602536a3-8a43-4c34-86f4-fc646f7b2d75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:33.559542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602536a3-8a43-4c34-86f4-fc646f7b2d75 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:33.566335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 456/901] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:13:33 2022] GET /identity/v3/services => generated 1268 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:13:34.411987 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003ee92-6437-4753-aa5c-6d37e3dc110b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.412576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003ee92-6437-4753-aa5c-6d37e3dc110b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.412576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003ee92-6437-4753-aa5c-6d37e3dc110b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.414827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 446/902] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:34.420564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3a9ba-c553-4656-b3d9-1b92b3649072 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.420993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3a9ba-c553-4656-b3d9-1b92b3649072 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.421247 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3a9ba-c553-4656-b3d9-1b92b3649072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.439122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4ae3a9ba-c553-4656-b3d9-1b92b3649072 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:34.440304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4ae3a9ba-c553-4656-b3d9-1b92b3649072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:34.453332 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 457/903] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:34 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:34.472584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003ee92-6437-4753-aa5c-6d37e3dc110b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:34.485291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003ee92-6437-4753-aa5c-6d37e3dc110b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:34.489738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45387a-78f7-4549-ab2e-ecaa16bea51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:34.490443 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45387a-78f7-4549-ab2e-ecaa16bea51d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.490726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45387a-78f7-4549-ab2e-ecaa16bea51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.490998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45387a-78f7-4549-ab2e-ecaa16bea51d admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.491787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45387a-78f7-4549-ab2e-ecaa16bea51d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:34.493511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45387a-78f7-4549-ab2e-ecaa16bea51d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:34.513417 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 447/904] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:13:34 2022] POST /identity/v3/services => generated 241 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:34.554237 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c75e-ff7f-45b7-a4f2-ae5d9c22b94b None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.554577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c75e-ff7f-45b7-a4f2-ae5d9c22b94b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.554774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c75e-ff7f-45b7-a4f2-ae5d9c22b94b None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.556883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 458/905] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:34.562667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b16a0-101d-4ca2-a485-bdbd10c0ae95 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.562942 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b16a0-101d-4ca2-a485-bdbd10c0ae95 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.563222 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b16a0-101d-4ca2-a485-bdbd10c0ae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.583172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ba8b16a0-101d-4ca2-a485-bdbd10c0ae95 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:34.584434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ba8b16a0-101d-4ca2-a485-bdbd10c0ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:34.603017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 448/906] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:34 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:34.632260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c75e-ff7f-45b7-a4f2-ae5d9c22b94b None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:34.645585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c75e-ff7f-45b7-a4f2-ae5d9c22b94b None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:34.650653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bddc39-64e8-4b88-a9d3-e4e4af950cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:34.651779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bddc39-64e8-4b88-a9d3-e4e4af950cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.652348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bddc39-64e8-4b88-a9d3-e4e4af950cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.652831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bddc39-64e8-4b88-a9d3-e4e4af950cc0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.665382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bddc39-64e8-4b88-a9d3-e4e4af950cc0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:34.673498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-b2bddc39-64e8-4b88-a9d3-e4e4af950cc0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:13:34.675480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 459/907] 10.222.0.16 () {56 vars in 1141 bytes} [Fri Jan 28 01:13:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:34.681619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b16a0-101d-4ca2-a485-bdbd10c0ae95 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:34.692842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b16a0-101d-4ca2-a485-bdbd10c0ae95 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:34.697974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5e646-0cc9-40f4-94e0-60f8eed0cf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:34.698986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5e646-0cc9-40f4-94e0-60f8eed0cf35 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.699473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5e646-0cc9-40f4-94e0-60f8eed0cf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.699926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5e646-0cc9-40f4-94e0-60f8eed0cf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.700882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5e646-0cc9-40f4-94e0-60f8eed0cf35 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:34.701424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5e646-0cc9-40f4-94e0-60f8eed0cf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:34.703326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5e646-0cc9-40f4-94e0-60f8eed0cf35 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:34.713312 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 449/908] 10.222.0.16 () {56 vars in 1136 bytes} [Fri Jan 28 01:13:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:34.719643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bddc39-64e8-4b88-a9d3-e4e4af950cc0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:34.730844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bddc39-64e8-4b88-a9d3-e4e4af950cc0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:34.735265 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2e85c-792f-496a-8b5c-d58d446c979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:34.736085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2e85c-792f-496a-8b5c-d58d446c979c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.736354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2e85c-792f-496a-8b5c-d58d446c979c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.736620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2e85c-792f-496a-8b5c-d58d446c979c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.747116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2e85c-792f-496a-8b5c-d58d446c979c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:34.748942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2e85c-792f-496a-8b5c-d58d446c979c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:34.765775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-61e2e85c-792f-496a-8b5c-d58d446c979c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:34.767279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 460/909] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:34.773098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5e646-0cc9-40f4-94e0-60f8eed0cf35 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:34.783025 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5e646-0cc9-40f4-94e0-60f8eed0cf35 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:34.787584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48e148-11af-4451-88c8-6709c3f3f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:34.788239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48e148-11af-4451-88c8-6709c3f3f66e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.788522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48e148-11af-4451-88c8-6709c3f3f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.788787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48e148-11af-4451-88c8-6709c3f3f66e admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.789568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48e148-11af-4451-88c8-6709c3f3f66e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:34.789868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48e148-11af-4451-88c8-6709c3f3f66e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:34.791472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48e148-11af-4451-88c8-6709c3f3f66e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:34.804000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 450/910] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:34.809540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2e85c-792f-496a-8b5c-d58d446c979c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:34.819522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2e85c-792f-496a-8b5c-d58d446c979c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:34.824219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91149c-3d01-4161-9707-4281daa1e6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:34.825016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91149c-3d01-4161-9707-4281daa1e6af admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.825364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91149c-3d01-4161-9707-4281daa1e6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.825643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91149c-3d01-4161-9707-4281daa1e6af admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.833296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91149c-3d01-4161-9707-4281daa1e6af admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:34.835400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91149c-3d01-4161-9707-4281daa1e6af admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:34.850656 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-2b91149c-3d01-4161-9707-4281daa1e6af admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:13:34.852137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 461/911] 10.222.0.16 () {56 vars in 1138 bytes} [Fri Jan 28 01:13:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:34.858023 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48e148-11af-4451-88c8-6709c3f3f66e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:34.868227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48e148-11af-4451-88c8-6709c3f3f66e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:34.873063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44f611-fcea-4ea0-abce-3e509557c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:34.873986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f611-fcea-4ea0-abce-3e509557c1cf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.874457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f611-fcea-4ea0-abce-3e509557c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.874916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f611-fcea-4ea0-abce-3e509557c1cf admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.875976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44f611-fcea-4ea0-abce-3e509557c1cf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:34.876491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44f611-fcea-4ea0-abce-3e509557c1cf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:34.878588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44f611-fcea-4ea0-abce-3e509557c1cf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:34.903208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 451/912] 10.222.0.16 () {56 vars in 1170 bytes} [Fri Jan 28 01:13:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:34.905059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91149c-3d01-4161-9707-4281daa1e6af admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:34.915188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91149c-3d01-4161-9707-4281daa1e6af admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:34.920020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195c4de-62b3-48ed-868c-56b8078f517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:34.921031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195c4de-62b3-48ed-868c-56b8078f517b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.921533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195c4de-62b3-48ed-868c-56b8078f517b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.921996 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195c4de-62b3-48ed-868c-56b8078f517b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.932895 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195c4de-62b3-48ed-868c-56b8078f517b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:34.935080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195c4de-62b3-48ed-868c-56b8078f517b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:34.952675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-7195c4de-62b3-48ed-868c-56b8078f517b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:34.954231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 462/913] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:34.960189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44f611-fcea-4ea0-abce-3e509557c1cf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:34.970777 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44f611-fcea-4ea0-abce-3e509557c1cf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:34.976342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d96f2-f214-426c-acd0-759ce1a54d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:34.977449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d96f2-f214-426c-acd0-759ce1a54d31 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:34.977927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d96f2-f214-426c-acd0-759ce1a54d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:34.978407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d96f2-f214-426c-acd0-759ce1a54d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:34.979379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d96f2-f214-426c-acd0-759ce1a54d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:34.979892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d96f2-f214-426c-acd0-759ce1a54d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:34.982031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d96f2-f214-426c-acd0-759ce1a54d31 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.000761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 452/914] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:35.002517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195c4de-62b3-48ed-868c-56b8078f517b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.012882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195c4de-62b3-48ed-868c-56b8078f517b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.017655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ab860-2c57-4bfa-b28d-d01041357af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.018707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab860-2c57-4bfa-b28d-d01041357af1 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.019178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab860-2c57-4bfa-b28d-d01041357af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.019635 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ab860-2c57-4bfa-b28d-d01041357af1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.027058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab860-2c57-4bfa-b28d-d01041357af1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.029257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ab860-2c57-4bfa-b28d-d01041357af1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.042250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-c86ab860-2c57-4bfa-b28d-d01041357af1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:35.049671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 463/915] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:35.051217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d96f2-f214-426c-acd0-759ce1a54d31 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.061509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d96f2-f214-426c-acd0-759ce1a54d31 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.066186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b36ac-374d-48f7-8cb0-c1bcde31ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.067093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b36ac-374d-48f7-8cb0-c1bcde31ef4e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.067564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b36ac-374d-48f7-8cb0-c1bcde31ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.068043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b36ac-374d-48f7-8cb0-c1bcde31ef4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.069029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b36ac-374d-48f7-8cb0-c1bcde31ef4e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:35.069561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b36ac-374d-48f7-8cb0-c1bcde31ef4e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.071600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b36ac-374d-48f7-8cb0-c1bcde31ef4e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.089355 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 453/916] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:35.091535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ab860-2c57-4bfa-b28d-d01041357af1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.102613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ab860-2c57-4bfa-b28d-d01041357af1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.107392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f833e-d45c-4e63-aadc-faad69b01c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.108491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f833e-d45c-4e63-aadc-faad69b01c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.108963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f833e-d45c-4e63-aadc-faad69b01c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.109471 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f833e-d45c-4e63-aadc-faad69b01c83 admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/b3b098dc0f2f465f947df6e136b33f68/roles/6c1451150c314b4b9938ad823b9a6512` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.111867 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f833e-d45c-4e63-aadc-faad69b01c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=b3b098dc0f2f465f947df6e136b33f68, role_id=6c1451150c314b4b9938ad823b9a6512)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.114744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f833e-d45c-4e63-aadc-faad69b01c83 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.137349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 464/917] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:35 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/b3b098dc0f2f465f947df6e136b33f68/roles/6c1451150c314b4b9938ad823b9a6512 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:35.221608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd8db1-5168-4769-8c0d-663b6956f9d9 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.222596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd8db1-5168-4769-8c0d-663b6956f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.223062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd8db1-5168-4769-8c0d-663b6956f9d9 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.225527 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 454/918] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:35.231082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d28e-535d-4635-8cd5-b9484b424c56 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.231642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d28e-535d-4635-8cd5-b9484b424c56 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.232140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6d28e-535d-4635-8cd5-b9484b424c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.251559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-c6c6d28e-535d-4635-8cd5-b9484b424c56 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:35.253112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c6c6d28e-535d-4635-8cd5-b9484b424c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:35.316746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 465/919] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:35 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:35.342102 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd8db1-5168-4769-8c0d-663b6956f9d9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.355640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd8db1-5168-4769-8c0d-663b6956f9d9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.360444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48d56-4f20-4bb0-ac62-51ebed135b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.361476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48d56-4f20-4bb0-ac62-51ebed135b62 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.361977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48d56-4f20-4bb0-ac62-51ebed135b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.362452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c48d56-4f20-4bb0-ac62-51ebed135b62 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.363398 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c48d56-4f20-4bb0-ac62-51ebed135b62 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.365171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c48d56-4f20-4bb0-ac62-51ebed135b62 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.376829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e2c48d56-4f20-4bb0-ac62-51ebed135b62 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:13:35.383340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 455/920] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:13:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:35.384871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6d28e-535d-4635-8cd5-b9484b424c56 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.394332 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6d28e-535d-4635-8cd5-b9484b424c56 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.399018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949602-d8a9-499e-b712-387ba6c8a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.399842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949602-d8a9-499e-b712-387ba6c8a09d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.400257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949602-d8a9-499e-b712-387ba6c8a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.400665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949602-d8a9-499e-b712-387ba6c8a09d admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.401590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed949602-d8a9-499e-b712-387ba6c8a09d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:35.402074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed949602-d8a9-499e-b712-387ba6c8a09d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.403812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed949602-d8a9-499e-b712-387ba6c8a09d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.413349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 466/921] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:13:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:35.415541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48d56-4f20-4bb0-ac62-51ebed135b62 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.426365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c48d56-4f20-4bb0-ac62-51ebed135b62 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.431269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b41b16-2a3c-4cb0-a113-7d5ccd0186dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.432127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b41b16-2a3c-4cb0-a113-7d5ccd0186dd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.432542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b41b16-2a3c-4cb0-a113-7d5ccd0186dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.432968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b41b16-2a3c-4cb0-a113-7d5ccd0186dd admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.433923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b41b16-2a3c-4cb0-a113-7d5ccd0186dd admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:35.434421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b41b16-2a3c-4cb0-a113-7d5ccd0186dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.436181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b41b16-2a3c-4cb0-a113-7d5ccd0186dd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.446661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 456/922] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:13:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:35.448309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949602-d8a9-499e-b712-387ba6c8a09d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.458846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949602-d8a9-499e-b712-387ba6c8a09d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.463697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550af50c-9324-48ee-82d7-09450fdac5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.464619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550af50c-9324-48ee-82d7-09450fdac5df admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.465035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550af50c-9324-48ee-82d7-09450fdac5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.465491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550af50c-9324-48ee-82d7-09450fdac5df admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.466480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550af50c-9324-48ee-82d7-09450fdac5df admin admin] RBAC: Adding query filter params (interface=public, service_id=c0e6b3ce25f94553b7ac254b91edff61, region_id=RegionOne) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:35.466925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550af50c-9324-48ee-82d7-09450fdac5df admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.468727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550af50c-9324-48ee-82d7-09450fdac5df admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.479545 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 467/923] 10.222.0.16 () {56 vars in 1272 bytes} [Fri Jan 28 01:13:35 2022] GET /identity/v3/endpoints?service_id=c0e6b3ce25f94553b7ac254b91edff61&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:35.481169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b41b16-2a3c-4cb0-a113-7d5ccd0186dd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.491425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b41b16-2a3c-4cb0-a113-7d5ccd0186dd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.496220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73292d7-23d4-4d8c-9d3e-53fa69e0700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.497083 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73292d7-23d4-4d8c-9d3e-53fa69e0700e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.497518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73292d7-23d4-4d8c-9d3e-53fa69e0700e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.497927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73292d7-23d4-4d8c-9d3e-53fa69e0700e admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.498807 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73292d7-23d4-4d8c-9d3e-53fa69e0700e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.500583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73292d7-23d4-4d8c-9d3e-53fa69e0700e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.513388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 457/924] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:13:35 2022] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:13:35.816054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e731-b25b-4e49-bb5f-b2aa76b56799 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.816249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e731-b25b-4e49-bb5f-b2aa76b56799 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.816514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e731-b25b-4e49-bb5f-b2aa76b56799 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.818541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 468/925] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:35.824121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5cd2-0d8f-4652-a88f-9dfa51a82558 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.824406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5cd2-0d8f-4652-a88f-9dfa51a82558 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.824673 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5cd2-0d8f-4652-a88f-9dfa51a82558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.842680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c62b5cd2-0d8f-4652-a88f-9dfa51a82558 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:35.843923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c62b5cd2-0d8f-4652-a88f-9dfa51a82558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:35.852213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 458/926] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:35 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:35.875319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7e731-b25b-4e49-bb5f-b2aa76b56799 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.888323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7e731-b25b-4e49-bb5f-b2aa76b56799 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.893606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30e35-e67d-4476-8f03-d97472b09841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.894505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30e35-e67d-4476-8f03-d97472b09841 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.894781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30e35-e67d-4476-8f03-d97472b09841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.895050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30e35-e67d-4476-8f03-d97472b09841 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.895776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f30e35-e67d-4476-8f03-d97472b09841 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.897474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f30e35-e67d-4476-8f03-d97472b09841 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.909114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-69f30e35-e67d-4476-8f03-d97472b09841 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 28 01:13:35.910576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 469/927] 10.222.0.16 () {56 vars in 1153 bytes} [Fri Jan 28 01:13:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:35.916564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b5cd2-0d8f-4652-a88f-9dfa51a82558 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.925632 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b5cd2-0d8f-4652-a88f-9dfa51a82558 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.930262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e9a1b-41a0-4930-96d6-0c37b67e32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.930914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9a1b-41a0-4930-96d6-0c37b67e32ab admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.931189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9a1b-41a0-4930-96d6-0c37b67e32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.931553 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9a1b-41a0-4930-96d6-0c37b67e32ab admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.932274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e9a1b-41a0-4930-96d6-0c37b67e32ab admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:35.932571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e9a1b-41a0-4930-96d6-0c37b67e32ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.934469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e9a1b-41a0-4930-96d6-0c37b67e32ab admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.939832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 459/928] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:35.945423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30e35-e67d-4476-8f03-d97472b09841 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.955499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30e35-e67d-4476-8f03-d97472b09841 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.960049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f664e-370c-4032-b013-2be736a4c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.960699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f664e-370c-4032-b013-2be736a4c560 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.961021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f664e-370c-4032-b013-2be736a4c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.961328 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f664e-370c-4032-b013-2be736a4c560 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.962130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f664e-370c-4032-b013-2be736a4c560 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:35.962432 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f664e-370c-4032-b013-2be736a4c560 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.964081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f664e-370c-4032-b013-2be736a4c560 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:35.969499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 470/929] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:35.975416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e9a1b-41a0-4930-96d6-0c37b67e32ab admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:35.987039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e9a1b-41a0-4930-96d6-0c37b67e32ab admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:35.991943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752efca-a8dc-4354-8ec7-778f24be79a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:35.992806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752efca-a8dc-4354-8ec7-778f24be79a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:35.993310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752efca-a8dc-4354-8ec7-778f24be79a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:35.993774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752efca-a8dc-4354-8ec7-778f24be79a2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:35.994743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752efca-a8dc-4354-8ec7-778f24be79a2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:35.996566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752efca-a8dc-4354-8ec7-778f24be79a2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:36.021393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 460/930] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Jan 28 01:13:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:36.895693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899f70-0c36-45bf-9169-f22a00c42ffe None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:36.896216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899f70-0c36-45bf-9169-f22a00c42ffe None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:36.896216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0899f70-0c36-45bf-9169-f22a00c42ffe None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:36.898207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 471/931] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:36.903734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cccbea-4283-45f6-a241-1f704382c800 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:36.904143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cccbea-4283-45f6-a241-1f704382c800 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:36.904298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cccbea-4283-45f6-a241-1f704382c800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:36.922309 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-42cccbea-4283-45f6-a241-1f704382c800 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:36.923486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-42cccbea-4283-45f6-a241-1f704382c800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:36.940572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 461/932] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:36 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:36.963912 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0899f70-0c36-45bf-9169-f22a00c42ffe None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:36.976652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0899f70-0c36-45bf-9169-f22a00c42ffe None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:36.981015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70b338-7327-41b2-b916-cefb666285f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:36.981833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70b338-7327-41b2-b916-cefb666285f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:36.982111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70b338-7327-41b2-b916-cefb666285f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:36.982379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70b338-7327-41b2-b916-cefb666285f6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:36.983049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70b338-7327-41b2-b916-cefb666285f6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:36.984629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70b338-7327-41b2-b916-cefb666285f6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:36.995715 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-db70b338-7327-41b2-b916-cefb666285f6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:13:36.997150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 472/933] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:37.003242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cccbea-4283-45f6-a241-1f704382c800 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.012361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cccbea-4283-45f6-a241-1f704382c800 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.016938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7bacd-963e-41e9-8bd4-4b53562d725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.017630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7bacd-963e-41e9-8bd4-4b53562d725c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.017907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7bacd-963e-41e9-8bd4-4b53562d725c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.018177 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7bacd-963e-41e9-8bd4-4b53562d725c admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.018899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7bacd-963e-41e9-8bd4-4b53562d725c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:37.019200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7bacd-963e-41e9-8bd4-4b53562d725c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.020788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7bacd-963e-41e9-8bd4-4b53562d725c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.026046 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 462/934] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:37.031646 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70b338-7327-41b2-b916-cefb666285f6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.042257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70b338-7327-41b2-b916-cefb666285f6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.046917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8afee-2f2f-4d06-81d3-0865e4918d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.047573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8afee-2f2f-4d06-81d3-0865e4918d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.047848 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8afee-2f2f-4d06-81d3-0865e4918d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.048119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8afee-2f2f-4d06-81d3-0865e4918d97 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.048839 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8afee-2f2f-4d06-81d3-0865e4918d97 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:37.049141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8afee-2f2f-4d06-81d3-0865e4918d97 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.050765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8afee-2f2f-4d06-81d3-0865e4918d97 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.056390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 473/935] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:37.062277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7bacd-963e-41e9-8bd4-4b53562d725c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.071962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7bacd-963e-41e9-8bd4-4b53562d725c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.076447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ce98d-0628-4bd1-8311-5c1aed58af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.077086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ce98d-0628-4bd1-8311-5c1aed58af2d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.077406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ce98d-0628-4bd1-8311-5c1aed58af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.077682 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ce98d-0628-4bd1-8311-5c1aed58af2d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.078483 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ce98d-0628-4bd1-8311-5c1aed58af2d admin admin] RBAC: Adding query filter params (interface=public, service_id=e970e35e012c42cbaf5cc7400c71ead3, region_id=RegionOne) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:37.078792 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ce98d-0628-4bd1-8311-5c1aed58af2d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.080371 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ce98d-0628-4bd1-8311-5c1aed58af2d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.085696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 463/936] 10.222.0.16 () {56 vars in 1272 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/endpoints?service_id=e970e35e012c42cbaf5cc7400c71ead3&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:37.091244 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8afee-2f2f-4d06-81d3-0865e4918d97 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.101599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8afee-2f2f-4d06-81d3-0865e4918d97 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.106289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4eb489-8004-4939-bdbd-c5f64071f1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.106950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4eb489-8004-4939-bdbd-c5f64071f1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.107225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4eb489-8004-4939-bdbd-c5f64071f1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.107496 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4eb489-8004-4939-bdbd-c5f64071f1b4 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.108195 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4eb489-8004-4939-bdbd-c5f64071f1b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.109886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4eb489-8004-4939-bdbd-c5f64071f1b4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.116623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 474/937] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/services => generated 1497 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:13:37.397280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15140f-38d6-4ca3-8b4b-09613a2c7dd4 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.397280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15140f-38d6-4ca3-8b4b-09613a2c7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.397280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15140f-38d6-4ca3-8b4b-09613a2c7dd4 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.398625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 464/938] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:37.404353 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153cc3c-f77b-4c4e-8eac-4dba54ba1574 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.404897 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153cc3c-f77b-4c4e-8eac-4dba54ba1574 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.405401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153cc3c-f77b-4c4e-8eac-4dba54ba1574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.424811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-7153cc3c-f77b-4c4e-8eac-4dba54ba1574 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:37.426403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7153cc3c-f77b-4c4e-8eac-4dba54ba1574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:37.435392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 475/939] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:37 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:37.460184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15140f-38d6-4ca3-8b4b-09613a2c7dd4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.473626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15140f-38d6-4ca3-8b4b-09613a2c7dd4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.478403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3507491-1a27-44f5-b621-c1fb7cadeffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.479453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507491-1a27-44f5-b621-c1fb7cadeffd admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.479937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507491-1a27-44f5-b621-c1fb7cadeffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.480434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3507491-1a27-44f5-b621-c1fb7cadeffd admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.491758 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3507491-1a27-44f5-b621-c1fb7cadeffd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:37.499768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-f3507491-1a27-44f5-b621-c1fb7cadeffd admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:13:37.501608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 465/940] 10.222.0.16 () {56 vars in 1141 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:37.507969 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153cc3c-f77b-4c4e-8eac-4dba54ba1574 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.518320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153cc3c-f77b-4c4e-8eac-4dba54ba1574 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.523592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918e246-3709-4c9c-a1ab-6df1de4d2e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.524659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918e246-3709-4c9c-a1ab-6df1de4d2e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.525134 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918e246-3709-4c9c-a1ab-6df1de4d2e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.525637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918e246-3709-4c9c-a1ab-6df1de4d2e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.526618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918e246-3709-4c9c-a1ab-6df1de4d2e1b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:37.527281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918e246-3709-4c9c-a1ab-6df1de4d2e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.529333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918e246-3709-4c9c-a1ab-6df1de4d2e1b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.539282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 476/941] 10.222.0.16 () {56 vars in 1136 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:37.545589 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3507491-1a27-44f5-b621-c1fb7cadeffd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.556105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3507491-1a27-44f5-b621-c1fb7cadeffd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.560928 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae1536-8089-4205-bd6c-89dddf82e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.561985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae1536-8089-4205-bd6c-89dddf82e313 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.562476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae1536-8089-4205-bd6c-89dddf82e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.562943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae1536-8089-4205-bd6c-89dddf82e313 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.573508 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae1536-8089-4205-bd6c-89dddf82e313 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.575753 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae1536-8089-4205-bd6c-89dddf82e313 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.592534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-ddae1536-8089-4205-bd6c-89dddf82e313 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:37.594287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 466/942] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:37.600580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918e246-3709-4c9c-a1ab-6df1de4d2e1b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.610836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918e246-3709-4c9c-a1ab-6df1de4d2e1b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.617833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a062e9-dc1f-4c7a-bc86-e3ba1ae9f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.618580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a062e9-dc1f-4c7a-bc86-e3ba1ae9f576 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.618857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a062e9-dc1f-4c7a-bc86-e3ba1ae9f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.619176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a062e9-dc1f-4c7a-bc86-e3ba1ae9f576 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.619915 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a062e9-dc1f-4c7a-bc86-e3ba1ae9f576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:37.620221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a062e9-dc1f-4c7a-bc86-e3ba1ae9f576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.621968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a062e9-dc1f-4c7a-bc86-e3ba1ae9f576 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.639418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 477/943] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:37.645266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae1536-8089-4205-bd6c-89dddf82e313 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.655841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae1536-8089-4205-bd6c-89dddf82e313 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.660865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163314-8a92-4dca-bcf4-7e889bf03e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.661966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163314-8a92-4dca-bcf4-7e889bf03e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.662487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163314-8a92-4dca-bcf4-7e889bf03e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.662978 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25163314-8a92-4dca-bcf4-7e889bf03e1b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.671223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25163314-8a92-4dca-bcf4-7e889bf03e1b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.673580 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25163314-8a92-4dca-bcf4-7e889bf03e1b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.688707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-25163314-8a92-4dca-bcf4-7e889bf03e1b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 28 01:13:37.690468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 467/944] 10.222.0.16 () {56 vars in 1138 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:37.696454 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a062e9-dc1f-4c7a-bc86-e3ba1ae9f576 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.706998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a062e9-dc1f-4c7a-bc86-e3ba1ae9f576 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.712000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56562ff2-0bc7-4b67-bf1a-75df21c13bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.712882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562ff2-0bc7-4b67-bf1a-75df21c13bbf admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.713418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562ff2-0bc7-4b67-bf1a-75df21c13bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.713928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562ff2-0bc7-4b67-bf1a-75df21c13bbf admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.715099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56562ff2-0bc7-4b67-bf1a-75df21c13bbf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:37.715636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56562ff2-0bc7-4b67-bf1a-75df21c13bbf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.717777 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56562ff2-0bc7-4b67-bf1a-75df21c13bbf admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.736097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 478/945] 10.222.0.16 () {56 vars in 1170 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:37.742093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163314-8a92-4dca-bcf4-7e889bf03e1b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.752451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25163314-8a92-4dca-bcf4-7e889bf03e1b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.756992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fed125-e2a4-429b-b19b-43b38f3f2307 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.757306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fed125-e2a4-429b-b19b-43b38f3f2307 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.757581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fed125-e2a4-429b-b19b-43b38f3f2307 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.758160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d13d6b-103e-49c8-bc42-360ae5e23047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.759062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13d6b-103e-49c8-bc42-360ae5e23047 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.759579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 479/946] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:13:37.759683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13d6b-103e-49c8-bc42-360ae5e23047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.760128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13d6b-103e-49c8-bc42-360ae5e23047 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.764445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e9861-9862-4e69-91e4-90559e0eb658 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.764729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e9861-9862-4e69-91e4-90559e0eb658 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.765000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e9861-9862-4e69-91e4-90559e0eb658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.770412 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d13d6b-103e-49c8-bc42-360ae5e23047 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.772470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d13d6b-103e-49c8-bc42-360ae5e23047 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.782216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 468/947] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:13:37.787846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d13d6b-103e-49c8-bc42-360ae5e23047 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.787989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-cd8e9861-9862-4e69-91e4-90559e0eb658 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:37.789403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-cd8e9861-9862-4e69-91e4-90559e0eb658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:37.797537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d13d6b-103e-49c8-bc42-360ae5e23047 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.799770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 480/948] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:37 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:37.805290 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c64f9-6801-4487-a765-22d23218673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.805290 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c64f9-6801-4487-a765-22d23218673d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.805290 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c64f9-6801-4487-a765-22d23218673d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.805290 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c64f9-6801-4487-a765-22d23218673d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.814490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c64f9-6801-4487-a765-22d23218673d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.816325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c64f9-6801-4487-a765-22d23218673d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.826278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e9861-9862-4e69-91e4-90559e0eb658 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.835267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e9861-9862-4e69-91e4-90559e0eb658 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.837735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0c0c64f9-6801-4487-a765-22d23218673d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:37.838959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 469/949] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:37.844817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19555d41-3946-4716-9808-34a681be50f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.845215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c64f9-6801-4487-a765-22d23218673d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.845656 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19555d41-3946-4716-9808-34a681be50f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.845940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19555d41-3946-4716-9808-34a681be50f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.846216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19555d41-3946-4716-9808-34a681be50f8 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.846890 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19555d41-3946-4716-9808-34a681be50f8 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.848869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19555d41-3946-4716-9808-34a681be50f8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.855547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c64f9-6801-4487-a765-22d23218673d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.860127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4dde1-35ff-429e-8971-334983b42312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.860771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4dde1-35ff-429e-8971-334983b42312 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.861046 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4dde1-35ff-429e-8971-334983b42312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.861343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4dde1-35ff-429e-8971-334983b42312 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.861670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-19555d41-3946-4716-9808-34a681be50f8 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 28 01:13:37.862072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4dde1-35ff-429e-8971-334983b42312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:37.862371 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4dde1-35ff-429e-8971-334983b42312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.863233 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 481/950] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:37.863933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4dde1-35ff-429e-8971-334983b42312 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.871325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19555d41-3946-4716-9808-34a681be50f8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.880566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 470/951] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:37.882063 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19555d41-3946-4716-9808-34a681be50f8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.886298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4dde1-35ff-429e-8971-334983b42312 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.887940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae8c8d-f61d-465a-9d95-a19df817bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.888833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae8c8d-f61d-465a-9d95-a19df817bc31 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.889343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae8c8d-f61d-465a-9d95-a19df817bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.889807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae8c8d-f61d-465a-9d95-a19df817bc31 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.890821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae8c8d-f61d-465a-9d95-a19df817bc31 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:37.891645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae8c8d-f61d-465a-9d95-a19df817bc31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.894449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae8c8d-f61d-465a-9d95-a19df817bc31 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.896417 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4dde1-35ff-429e-8971-334983b42312 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.900120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 482/952] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:37.902900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec6539-734c-4dbf-b16d-fb064f408c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.903994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec6539-734c-4dbf-b16d-fb064f408c93 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.904864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec6539-734c-4dbf-b16d-fb064f408c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.905935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae8c8d-f61d-465a-9d95-a19df817bc31 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.906534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec6539-734c-4dbf-b16d-fb064f408c93 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.916182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec6539-734c-4dbf-b16d-fb064f408c93 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.918270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec6539-734c-4dbf-b16d-fb064f408c93 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.919504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae8c8d-f61d-465a-9d95-a19df817bc31 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.925096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b9a9a-d1b5-4479-b9f8-54b7ce35d40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.926013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9a9a-d1b5-4479-b9f8-54b7ce35d40f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.926514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9a9a-d1b5-4479-b9f8-54b7ce35d40f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.926982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9a9a-d1b5-4479-b9f8-54b7ce35d40f admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.927909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b9a9a-d1b5-4479-b9f8-54b7ce35d40f admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:37.928404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b9a9a-d1b5-4479-b9f8-54b7ce35d40f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.930206 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b9a9a-d1b5-4479-b9f8-54b7ce35d40f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.933037 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a0ec6539-734c-4dbf-b16d-fb064f408c93 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:37.939203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 471/953] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:37.940202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec6539-734c-4dbf-b16d-fb064f408c93 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.941031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 483/954] 10.222.0.16 () {56 vars in 1135 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:37.946663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b9a9a-d1b5-4479-b9f8-54b7ce35d40f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.957827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec6539-734c-4dbf-b16d-fb064f408c93 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.960548 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b9a9a-d1b5-4479-b9f8-54b7ce35d40f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:37.962579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec33b25-58f2-487f-a66c-6bc598f6960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.963215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec33b25-58f2-487f-a66c-6bc598f6960d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.963491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec33b25-58f2-487f-a66c-6bc598f6960d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.963756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec33b25-58f2-487f-a66c-6bc598f6960d admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.964658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec33b25-58f2-487f-a66c-6bc598f6960d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:37.964959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec33b25-58f2-487f-a66c-6bc598f6960d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.966886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec33b25-58f2-487f-a66c-6bc598f6960d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.967478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd0d6d-1f29-4b64-bb0d-93ba5adf65e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:37.968430 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd0d6d-1f29-4b64-bb0d-93ba5adf65e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:37.969161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd0d6d-1f29-4b64-bb0d-93ba5adf65e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:37.970160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd0d6d-1f29-4b64-bb0d-93ba5adf65e9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:37.971143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd0d6d-1f29-4b64-bb0d-93ba5adf65e9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:37.973303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd0d6d-1f29-4b64-bb0d-93ba5adf65e9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:37.985013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 472/955] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:37.986388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec33b25-58f2-487f-a66c-6bc598f6960d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:37.998770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec33b25-58f2-487f-a66c-6bc598f6960d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:38.003959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f64cc-4d1e-45fc-a653-b0121b51eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:38.004776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f64cc-4d1e-45fc-a653-b0121b51eae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:38.005149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f64cc-4d1e-45fc-a653-b0121b51eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:38.005521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f64cc-4d1e-45fc-a653-b0121b51eae9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:38.006449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f64cc-4d1e-45fc-a653-b0121b51eae9 admin admin] RBAC: Adding query filter params (role.id=6c1451150c314b4b9938ad823b9a6512, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=b3b098dc0f2f465f947df6e136b33f68) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:38.006873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f64cc-4d1e-45fc-a653-b0121b51eae9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:38.013296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f64cc-4d1e-45fc-a653-b0121b51eae9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:38.013798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 484/956] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Jan 28 01:13:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:13:38.019179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 473/957] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:37 2022] GET /identity/v3/role_assignments?user.id=b3b098dc0f2f465f947df6e136b33f68&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=6c1451150c314b4b9938ad823b9a6512 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:38.371630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a044b-72f0-4d95-b2cf-94fa6fe53dab None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:38.371989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a044b-72f0-4d95-b2cf-94fa6fe53dab None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:38.372087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a044b-72f0-4d95-b2cf-94fa6fe53dab None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:38.374217 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 485/958] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:38.379702 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2fb8e-851c-4670-8527-596a1c32e9a7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:38.379988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2fb8e-851c-4670-8527-596a1c32e9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:38.380263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2fb8e-851c-4670-8527-596a1c32e9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:38.398831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d4a2fb8e-851c-4670-8527-596a1c32e9a7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:38.400024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d4a2fb8e-851c-4670-8527-596a1c32e9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:38.421344 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 474/959] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:38 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:38.439862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a044b-72f0-4d95-b2cf-94fa6fe53dab None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:38.452555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a044b-72f0-4d95-b2cf-94fa6fe53dab None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:38.456968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23249123-cbaf-4a4b-9483-dfb5117102df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:38.457772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23249123-cbaf-4a4b-9483-dfb5117102df admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:38.458047 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23249123-cbaf-4a4b-9483-dfb5117102df admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:38.458313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23249123-cbaf-4a4b-9483-dfb5117102df admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:38.458982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23249123-cbaf-4a4b-9483-dfb5117102df admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:38.460559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23249123-cbaf-4a4b-9483-dfb5117102df admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:38.471365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-23249123-cbaf-4a4b-9483-dfb5117102df admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:13:38.477352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 486/960] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:38.479234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2fb8e-851c-4670-8527-596a1c32e9a7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:38.488323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2fb8e-851c-4670-8527-596a1c32e9a7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:38.492992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbed7e7-3849-416c-a7b1-50dffba86457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:38.493762 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed7e7-3849-416c-a7b1-50dffba86457 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:38.494055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed7e7-3849-416c-a7b1-50dffba86457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:38.494325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbed7e7-3849-416c-a7b1-50dffba86457 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:38.495047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbed7e7-3849-416c-a7b1-50dffba86457 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:38.495348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbed7e7-3849-416c-a7b1-50dffba86457 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:38.496997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbed7e7-3849-416c-a7b1-50dffba86457 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:38.505383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 475/961] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:38.507701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23249123-cbaf-4a4b-9483-dfb5117102df admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:38.518063 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23249123-cbaf-4a4b-9483-dfb5117102df admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:38.522611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83ad62-5425-428d-883b-9dad25d3d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:38.523306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83ad62-5425-428d-883b-9dad25d3d54e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:38.523631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83ad62-5425-428d-883b-9dad25d3d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:38.523900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83ad62-5425-428d-883b-9dad25d3d54e admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:38.524659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83ad62-5425-428d-883b-9dad25d3d54e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:38.524967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83ad62-5425-428d-883b-9dad25d3d54e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:38.526652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83ad62-5425-428d-883b-9dad25d3d54e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:38.531156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 487/962] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:39.399598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb345d9-0b4c-4bc1-8ba9-e0a5501593df None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:39.400311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb345d9-0b4c-4bc1-8ba9-e0a5501593df None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:39.400311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb345d9-0b4c-4bc1-8ba9-e0a5501593df None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:39.402235 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 476/963] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:39.407816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5e442-ce7c-4bc7-a0b6-835c46506180 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:39.408295 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5e442-ce7c-4bc7-a0b6-835c46506180 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:39.408442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5e442-ce7c-4bc7-a0b6-835c46506180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:39.426162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-77d5e442-ce7c-4bc7-a0b6-835c46506180 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:39.427336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-77d5e442-ce7c-4bc7-a0b6-835c46506180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:39.441329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 488/964] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:39 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:39.459216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb345d9-0b4c-4bc1-8ba9-e0a5501593df None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:39.471515 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb345d9-0b4c-4bc1-8ba9-e0a5501593df None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:39.476327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f9f2a-96fa-4c25-8b65-2a567d04abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:39.477117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f9f2a-96fa-4c25-8b65-2a567d04abc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:39.477427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f9f2a-96fa-4c25-8b65-2a567d04abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:39.477698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f9f2a-96fa-4c25-8b65-2a567d04abc5 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:39.478368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f9f2a-96fa-4c25-8b65-2a567d04abc5 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:39.479965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f9f2a-96fa-4c25-8b65-2a567d04abc5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:39.491080 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-029f9f2a-96fa-4c25-8b65-2a567d04abc5 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:13:39.497307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 477/965] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:39.498652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5e442-ce7c-4bc7-a0b6-835c46506180 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:39.507918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5e442-ce7c-4bc7-a0b6-835c46506180 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:39.512417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42102d0f-101e-4d8f-be78-d8062f7c82b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:39.513073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102d0f-101e-4d8f-be78-d8062f7c82b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:39.513392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102d0f-101e-4d8f-be78-d8062f7c82b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:39.513663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102d0f-101e-4d8f-be78-d8062f7c82b3 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:39.514390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42102d0f-101e-4d8f-be78-d8062f7c82b3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:39.514689 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42102d0f-101e-4d8f-be78-d8062f7c82b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:39.516287 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42102d0f-101e-4d8f-be78-d8062f7c82b3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:39.521544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 489/966] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jan 28 01:13:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:39.527875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f9f2a-96fa-4c25-8b65-2a567d04abc5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:39.537373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f9f2a-96fa-4c25-8b65-2a567d04abc5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:39.542147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f071c-fc01-4973-9622-fdf86db761b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:39.543065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f071c-fc01-4973-9622-fdf86db761b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:39.543535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f071c-fc01-4973-9622-fdf86db761b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:39.543996 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f071c-fc01-4973-9622-fdf86db761b4 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:39.544896 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f071c-fc01-4973-9622-fdf86db761b4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:39.545439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f071c-fc01-4973-9622-fdf86db761b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:39.547257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f071c-fc01-4973-9622-fdf86db761b4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:39.552830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 478/967] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jan 28 01:13:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:39.558728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42102d0f-101e-4d8f-be78-d8062f7c82b3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:39.568706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42102d0f-101e-4d8f-be78-d8062f7c82b3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:39.573489 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b0358-c04a-45d8-9b83-81d7233e6557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:39.574393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0358-c04a-45d8-9b83-81d7233e6557 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:39.574863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0358-c04a-45d8-9b83-81d7233e6557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:39.575337 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b0358-c04a-45d8-9b83-81d7233e6557 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:39.576275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b0358-c04a-45d8-9b83-81d7233e6557 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:39.578087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b0358-c04a-45d8-9b83-81d7233e6557 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:39.599520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 490/968] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Jan 28 01:13:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:13:40.341084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab3320-1e10-4ed7-8611-30fd84e5faaf None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.341560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab3320-1e10-4ed7-8611-30fd84e5faaf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.341838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab3320-1e10-4ed7-8611-30fd84e5faaf None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.344104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 479/969] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:40.350038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1290c7-f43d-464f-b9d2-fe5c4e13e972 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.350357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1290c7-f43d-464f-b9d2-fe5c4e13e972 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.350595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1290c7-f43d-464f-b9d2-fe5c4e13e972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.356775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415900-964f-4d85-965c-ed805c3844dc None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.357372 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415900-964f-4d85-965c-ed805c3844dc None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.357862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415900-964f-4d85-965c-ed805c3844dc None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.360073 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 480/970] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:40.365559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839fc3f-a1a8-40c2-a42b-7917b568df44 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.366116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839fc3f-a1a8-40c2-a42b-7917b568df44 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.366588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839fc3f-a1a8-40c2-a42b-7917b568df44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.369349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-dd1290c7-f43d-464f-b9d2-fe5c4e13e972 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:40.370578 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-dd1290c7-f43d-464f-b9d2-fe5c4e13e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:40.386374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2839fc3f-a1a8-40c2-a42b-7917b568df44 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:40.388108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2839fc3f-a1a8-40c2-a42b-7917b568df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:40.392918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 491/971] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:40 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:40.396929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 481/972] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:40 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:40.411331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1290c7-f43d-464f-b9d2-fe5c4e13e972 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:40.420647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1290c7-f43d-464f-b9d2-fe5c4e13e972 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:40.422131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839fc3f-a1a8-40c2-a42b-7917b568df44 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:40.425892 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef651be-bafc-43b9-b619-3091a57847df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:40.426809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef651be-bafc-43b9-b619-3091a57847df admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.427148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef651be-bafc-43b9-b619-3091a57847df admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.427524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef651be-bafc-43b9-b619-3091a57847df admin admin] PATH_INFO: `/v3/services/image` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.428338 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef651be-bafc-43b9-b619-3091a57847df admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:40.430066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef651be-bafc-43b9-b619-3091a57847df admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:40.434035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839fc3f-a1a8-40c2-a42b-7917b568df44 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:40.438604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:40.439362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.439731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.440089 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.440907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:40.442120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-4ef651be-bafc-43b9-b619-3091a57847df admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:13:40.443082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:40.448505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.common [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 28 01:13:40.449169 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 492/973] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jan 28 01:13:40 2022] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:40.450671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef651be-bafc-43b9-b619-3091a57847df admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:40.460415 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef651be-bafc-43b9-b619-3091a57847df admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:40.464603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.sql.core [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 28 01:13:40.464603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 28 01:13:40.464603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [parameters: {'id': '39ca77d230e3492aa5865ec44be5d268', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 28 01:13:40.464603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79113) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:13:40.466191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5e13-7b80-473c-ad95-0d091fa1a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:40.467051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5e13-7b80-473c-ad95-0d091fa1a585 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.467511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5e13-7b80-473c-ad95-0d091fa1a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.467962 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5e13-7b80-473c-ad95-0d091fa1a585 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.468852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf5e13-7b80-473c-ad95-0d091fa1a585 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:40.469407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf5e13-7b80-473c-ad95-0d091fa1a585 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:40.471155 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf5e13-7b80-473c-ad95-0d091fa1a585 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:40.481261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39ca77d230e3492aa5865ec44be5d268.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 39ca77d230e3492aa5865ec44be5d268. Jan 28 01:13:40.481816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 493/974] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:40.483230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 482/975] 10.222.0.16 () {60 vars in 1161 bytes} [Fri Jan 28 01:13:40 2022] POST /identity/v3/projects => generated 262 bytes in 62 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:40.483428 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5e13-7b80-473c-ad95-0d091fa1a585 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:40.490770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:40.498216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5e13-7b80-473c-ad95-0d091fa1a585 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:40.503075 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39773-b24c-4af9-aa29-881fc6dc3d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:40.503462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1fd45-6c66-40de-9602-63e93adb1115 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:40.504142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39773-b24c-4af9-aa29-881fc6dc3d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.504591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39773-b24c-4af9-aa29-881fc6dc3d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.505131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde39773-b24c-4af9-aa29-881fc6dc3d23 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.506065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39773-b24c-4af9-aa29-881fc6dc3d23 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:40.506535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39773-b24c-4af9-aa29-881fc6dc3d23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:40.508376 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c2636-cbd9-41cb-8b94-bb377f3485b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:40.508586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde39773-b24c-4af9-aa29-881fc6dc3d23 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:40.509333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2636-cbd9-41cb-8b94-bb377f3485b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.509674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2636-cbd9-41cb-8b94-bb377f3485b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.510006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2636-cbd9-41cb-8b94-bb377f3485b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.521255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c2636-cbd9-41cb-8b94-bb377f3485b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:40.521255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c2636-cbd9-41cb-8b94-bb377f3485b2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:40.521763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 494/976] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:40.534496 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-de4c2636-cbd9-41cb-8b94-bb377f3485b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:40.536273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 483/977] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:40.543069 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39773-b24c-4af9-aa29-881fc6dc3d23 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:40.554884 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde39773-b24c-4af9-aa29-881fc6dc3d23 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:40.560385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834edf0-4f2b-4294-a272-18e42d9c3c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:40.561498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834edf0-4f2b-4294-a272-18e42d9c3c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.562004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834edf0-4f2b-4294-a272-18e42d9c3c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.562447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834edf0-4f2b-4294-a272-18e42d9c3c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.563495 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834edf0-4f2b-4294-a272-18e42d9c3c11 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:40.564075 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834edf0-4f2b-4294-a272-18e42d9c3c11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:40.566439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834edf0-4f2b-4294-a272-18e42d9c3c11 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:40.587074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 495/978] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:40.810922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f686e-1bdb-47d7-890a-30096b3e60f1 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.811215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f686e-1bdb-47d7-890a-30096b3e60f1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.811663 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f686e-1bdb-47d7-890a-30096b3e60f1 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.816381 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 484/979] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:40.822165 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0b34c-212b-4d26-9869-53396a3d6cbd None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.822454 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0b34c-212b-4d26-9869-53396a3d6cbd None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.822732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0b34c-212b-4d26-9869-53396a3d6cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.841371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-61c0b34c-212b-4d26-9869-53396a3d6cbd None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:40.842565 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-61c0b34c-212b-4d26-9869-53396a3d6cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:40.850870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 496/980] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:40 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:40.874197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f686e-1bdb-47d7-890a-30096b3e60f1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:40.889659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f686e-1bdb-47d7-890a-30096b3e60f1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:40.894129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3530e-a7b3-4f40-a4ae-8baf81ddd579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:40.894778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3530e-a7b3-4f40-a4ae-8baf81ddd579 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:40.895064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3530e-a7b3-4f40-a4ae-8baf81ddd579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:40.895333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3530e-a7b3-4f40-a4ae-8baf81ddd579 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:40.896078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3530e-a7b3-4f40-a4ae-8baf81ddd579 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:40.897797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3530e-a7b3-4f40-a4ae-8baf81ddd579 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:40.914225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 485/981] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:13:40 2022] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:41.864489 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ec43-b2e9-4e39-8dff-94f707ff72de None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:41.865036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ec43-b2e9-4e39-8dff-94f707ff72de None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:41.865036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ec43-b2e9-4e39-8dff-94f707ff72de None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:41.867128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 497/982] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:41.873802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b721b-7f49-42f5-9640-ab2330922383 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:41.874230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b721b-7f49-42f5-9640-ab2330922383 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:41.874325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b721b-7f49-42f5-9640-ab2330922383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:41.896453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8e2b721b-7f49-42f5-9640-ab2330922383 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:41.898332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8e2b721b-7f49-42f5-9640-ab2330922383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:41.915958 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 486/983] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:41 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:41.939030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255ec43-b2e9-4e39-8dff-94f707ff72de None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:41.951551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255ec43-b2e9-4e39-8dff-94f707ff72de None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:41.956412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e274b6-9317-4d1d-9d6d-626a6a587bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:41.957509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e274b6-9317-4d1d-9d6d-626a6a587bae admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:41.957980 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e274b6-9317-4d1d-9d6d-626a6a587bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:41.958458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e274b6-9317-4d1d-9d6d-626a6a587bae admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:41.959445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e274b6-9317-4d1d-9d6d-626a6a587bae admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:41.961251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e274b6-9317-4d1d-9d6d-626a6a587bae admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:41.973345 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-72e274b6-9317-4d1d-9d6d-626a6a587bae admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:13:41.975056 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 498/984] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:41.981319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b721b-7f49-42f5-9640-ab2330922383 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:41.990649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b721b-7f49-42f5-9640-ab2330922383 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:41.995548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768559-d199-464a-b3da-da1166c81d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:41.996584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768559-d199-464a-b3da-da1166c81d15 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:41.997068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768559-d199-464a-b3da-da1166c81d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:41.997625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca768559-d199-464a-b3da-da1166c81d15 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:41.998566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca768559-d199-464a-b3da-da1166c81d15 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:41.999053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca768559-d199-464a-b3da-da1166c81d15 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:42.000823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca768559-d199-464a-b3da-da1166c81d15 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:42.006500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 487/985] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jan 28 01:13:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:42.012472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e274b6-9317-4d1d-9d6d-626a6a587bae admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:42.022456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e274b6-9317-4d1d-9d6d-626a6a587bae admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:42.027239 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7ecb6-b281-4571-b1b6-c2c3307fff96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:42.028140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7ecb6-b281-4571-b1b6-c2c3307fff96 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:42.028650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7ecb6-b281-4571-b1b6-c2c3307fff96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:42.029110 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7ecb6-b281-4571-b1b6-c2c3307fff96 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:42.030050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7ecb6-b281-4571-b1b6-c2c3307fff96 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:42.030551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7ecb6-b281-4571-b1b6-c2c3307fff96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:42.032363 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7ecb6-b281-4571-b1b6-c2c3307fff96 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:42.038256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 499/986] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jan 28 01:13:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:42.044710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768559-d199-464a-b3da-da1166c81d15 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:42.055394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca768559-d199-464a-b3da-da1166c81d15 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:42.060507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e33608-0d0c-44a9-a271-9ab42f041551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:42.061435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e33608-0d0c-44a9-a271-9ab42f041551 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:42.061905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e33608-0d0c-44a9-a271-9ab42f041551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:42.062384 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e33608-0d0c-44a9-a271-9ab42f041551 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:42.063383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e33608-0d0c-44a9-a271-9ab42f041551 admin admin] RBAC: Adding query filter params (interface=admin, service_id=e970e35e012c42cbaf5cc7400c71ead3, region_id=RegionOne) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:42.063875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e33608-0d0c-44a9-a271-9ab42f041551 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:42.065783 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e33608-0d0c-44a9-a271-9ab42f041551 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:42.071970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 488/987] 10.222.0.16 () {56 vars in 1270 bytes} [Fri Jan 28 01:13:42 2022] GET /identity/v3/endpoints?service_id=e970e35e012c42cbaf5cc7400c71ead3&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:42.077883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7ecb6-b281-4571-b1b6-c2c3307fff96 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:42.088123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7ecb6-b281-4571-b1b6-c2c3307fff96 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:42.092991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2a828-9589-4232-afce-44ed7b9115c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:42.093949 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a828-9589-4232-afce-44ed7b9115c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:42.094467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a828-9589-4232-afce-44ed7b9115c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:42.094926 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a828-9589-4232-afce-44ed7b9115c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:42.095952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2a828-9589-4232-afce-44ed7b9115c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:42.098178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2a828-9589-4232-afce-44ed7b9115c0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:42.105558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 500/988] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:13:42 2022] GET /identity/v3/services => generated 1727 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:13:42.743276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68765ff-36fc-43f7-a8f1-9a9f389a776f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:42.743973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68765ff-36fc-43f7-a8f1-9a9f389a776f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:42.744448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68765ff-36fc-43f7-a8f1-9a9f389a776f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:42.746839 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 489/989] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:42.752357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c10c07-bf2c-4c65-b9bc-5f27dc4b905d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:42.752899 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c10c07-bf2c-4c65-b9bc-5f27dc4b905d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:42.753416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c10c07-bf2c-4c65-b9bc-5f27dc4b905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:42.771784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-c7c10c07-bf2c-4c65-b9bc-5f27dc4b905d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:42.773331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c7c10c07-bf2c-4c65-b9bc-5f27dc4b905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:42.781783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 501/990] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:42 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:42.805048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68765ff-36fc-43f7-a8f1-9a9f389a776f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:42.818126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68765ff-36fc-43f7-a8f1-9a9f389a776f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:42.822745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e092b-e452-4348-91d4-9f3ec0e12d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:42.823644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e092b-e452-4348-91d4-9f3ec0e12d67 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:42.824194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e092b-e452-4348-91d4-9f3ec0e12d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:42.824668 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e092b-e452-4348-91d4-9f3ec0e12d67 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:42.825646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e092b-e452-4348-91d4-9f3ec0e12d67 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:42.827413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e092b-e452-4348-91d4-9f3ec0e12d67 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:42.846452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 490/991] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:13:42 2022] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:42.905102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9414d-fe75-46d8-ba0a-991fa94ab50a None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:42.906184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9414d-fe75-46d8-ba0a-991fa94ab50a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:42.906669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9414d-fe75-46d8-ba0a-991fa94ab50a None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:42.909256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 502/992] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:42.915319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511fd70-3bdf-4683-8e76-10e828e0878f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:42.916320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511fd70-3bdf-4683-8e76-10e828e0878f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:42.916791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511fd70-3bdf-4683-8e76-10e828e0878f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:42.937536 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9511fd70-3bdf-4683-8e76-10e828e0878f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:42.939143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9511fd70-3bdf-4683-8e76-10e828e0878f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:42.958639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 491/993] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:42 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:42.984701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9414d-fe75-46d8-ba0a-991fa94ab50a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:42.997744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9414d-fe75-46d8-ba0a-991fa94ab50a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:43.002341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:43.003022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:43.003304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:43.003577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:43.004302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:43.006359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:43.007696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.common [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 28 01:13:43.021131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.sql.core [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 28 01:13:43.021131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 28 01:13:43.021131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [parameters: {'user_id': '5aee338a738b46dc82cfad267e4a96e5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 28 01:13:43.021131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79114) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 28 01:13:43.027254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 28 01:13:43.033406 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 503/994] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:13:42 2022] POST /identity/v3/users => generated 160 bytes in 45 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:43.035039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511fd70-3bdf-4683-8e76-10e828e0878f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:43.044749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511fd70-3bdf-4683-8e76-10e828e0878f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:43.049744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f479e-d4a2-4bb5-ad8c-4fb10b7b8d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:43.050531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f479e-d4a2-4bb5-ad8c-4fb10b7b8d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:43.050809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f479e-d4a2-4bb5-ad8c-4fb10b7b8d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:43.051080 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f479e-d4a2-4bb5-ad8c-4fb10b7b8d0f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:43.058833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f479e-d4a2-4bb5-ad8c-4fb10b7b8d0f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:43.060835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f479e-d4a2-4bb5-ad8c-4fb10b7b8d0f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:43.076141 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-442f479e-d4a2-4bb5-ad8c-4fb10b7b8d0f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 28 01:13:43.078218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 492/995] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:43.083837 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:43.094311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dc20b-de41-4442-8e55-f572275e4b1f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:43.099108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935ab41-c25e-42c5-a5fb-23eb6e94cbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:43.099768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935ab41-c25e-42c5-a5fb-23eb6e94cbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:43.100092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935ab41-c25e-42c5-a5fb-23eb6e94cbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:43.100371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935ab41-c25e-42c5-a5fb-23eb6e94cbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:43.101173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935ab41-c25e-42c5-a5fb-23eb6e94cbb3 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:43.101506 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935ab41-c25e-42c5-a5fb-23eb6e94cbb3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:43.103586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935ab41-c25e-42c5-a5fb-23eb6e94cbb3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:43.144828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 504/996] 10.222.0.16 () {56 vars in 1122 bytes} [Fri Jan 28 01:13:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:43.166899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2b1d7-b462-49b4-989f-ee577e14903f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:43.167086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2b1d7-b462-49b4-989f-ee577e14903f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:43.167401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2b1d7-b462-49b4-989f-ee577e14903f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:43.169638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 493/997] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:43.175631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d690d82-d94f-43e2-ba86-4f8e9770e363 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:43.175919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d690d82-d94f-43e2-ba86-4f8e9770e363 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:43.176198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d690d82-d94f-43e2-ba86-4f8e9770e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:43.195798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9d690d82-d94f-43e2-ba86-4f8e9770e363 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:43.197410 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9d690d82-d94f-43e2-ba86-4f8e9770e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:43.206090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 505/998] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:43 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:43.230425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2b1d7-b462-49b4-989f-ee577e14903f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:43.243491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2b1d7-b462-49b4-989f-ee577e14903f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:43.248579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd1460-ec24-4260-8c06-120ef18270d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:43.249488 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd1460-ec24-4260-8c06-120ef18270d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:43.249799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd1460-ec24-4260-8c06-120ef18270d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:43.250081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd1460-ec24-4260-8c06-120ef18270d8 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:43.250811 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd1460-ec24-4260-8c06-120ef18270d8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:43.252566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd1460-ec24-4260-8c06-120ef18270d8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:43.265015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-88bd1460-ec24-4260-8c06-120ef18270d8 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:13:43.266683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 494/999] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:43.272877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d690d82-d94f-43e2-ba86-4f8e9770e363 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:43.282628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d690d82-d94f-43e2-ba86-4f8e9770e363 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:43.287448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f34f1-b474-4e52-bb42-021040830278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:43.288190 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f34f1-b474-4e52-bb42-021040830278 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:43.288467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f34f1-b474-4e52-bb42-021040830278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:43.288752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f34f1-b474-4e52-bb42-021040830278 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:43.289770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f34f1-b474-4e52-bb42-021040830278 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:43.290075 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f34f1-b474-4e52-bb42-021040830278 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:43.291817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f34f1-b474-4e52-bb42-021040830278 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:43.299537 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 506/1000] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:43.304929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd1460-ec24-4260-8c06-120ef18270d8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:43.315573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd1460-ec24-4260-8c06-120ef18270d8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:43.320465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99885-8a79-4445-a8d0-896f5c71853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:43.321174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99885-8a79-4445-a8d0-896f5c71853d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:43.321504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99885-8a79-4445-a8d0-896f5c71853d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:43.321777 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99885-8a79-4445-a8d0-896f5c71853d admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:43.322580 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb99885-8a79-4445-a8d0-896f5c71853d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:43.322922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb99885-8a79-4445-a8d0-896f5c71853d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:43.324867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb99885-8a79-4445-a8d0-896f5c71853d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:43.331428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 495/1001] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:43.336817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f34f1-b474-4e52-bb42-021040830278 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:43.347445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f34f1-b474-4e52-bb42-021040830278 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:43.352268 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7966b-143b-409f-8606-d7d71b1a1405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:43.352973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7966b-143b-409f-8606-d7d71b1a1405 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:43.353277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7966b-143b-409f-8606-d7d71b1a1405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:43.353553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7966b-143b-409f-8606-d7d71b1a1405 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:43.354502 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7966b-143b-409f-8606-d7d71b1a1405 admin admin] RBAC: Adding query filter params (interface=public, service_id=a4a27ab86e634306a5d110cb6c833f0b, region_id=RegionOne) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:43.354812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7966b-143b-409f-8606-d7d71b1a1405 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:43.356509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7966b-143b-409f-8606-d7d71b1a1405 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:43.362218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 507/1002] 10.222.0.16 () {56 vars in 1272 bytes} [Fri Jan 28 01:13:43 2022] GET /identity/v3/endpoints?service_id=a4a27ab86e634306a5d110cb6c833f0b&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:43.367707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99885-8a79-4445-a8d0-896f5c71853d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:43.378017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99885-8a79-4445-a8d0-896f5c71853d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:43.382590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a6a16-0d89-4db6-a64a-25b69dfff286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:43.383265 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a6a16-0d89-4db6-a64a-25b69dfff286 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:43.383543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a6a16-0d89-4db6-a64a-25b69dfff286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:43.383814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a6a16-0d89-4db6-a64a-25b69dfff286 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:43.384505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a6a16-0d89-4db6-a64a-25b69dfff286 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:43.386176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a6a16-0d89-4db6-a64a-25b69dfff286 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:43.393302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 496/1003] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:13:43 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:13:44.296665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921b93e-2622-4358-82a2-be2e654aa69e None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:44.297281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921b93e-2622-4358-82a2-be2e654aa69e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:44.297281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921b93e-2622-4358-82a2-be2e654aa69e None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:44.299166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 508/1004] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:44.304276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9a472-c922-47df-84de-8052ea8554cb None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:44.304710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9a472-c922-47df-84de-8052ea8554cb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:44.304784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9a472-c922-47df-84de-8052ea8554cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:44.322609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-49a9a472-c922-47df-84de-8052ea8554cb None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:44.323871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-49a9a472-c922-47df-84de-8052ea8554cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:44.331846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 497/1005] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:44 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:13:44.354876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921b93e-2622-4358-82a2-be2e654aa69e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:44.368168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921b93e-2622-4358-82a2-be2e654aa69e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:44.372771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd99b-41f5-4294-9266-5bf2859062e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:44.373610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd99b-41f5-4294-9266-5bf2859062e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:44.373889 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd99b-41f5-4294-9266-5bf2859062e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:44.374160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd99b-41f5-4294-9266-5bf2859062e4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:44.374830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bd99b-41f5-4294-9266-5bf2859062e4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:44.376423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bd99b-41f5-4294-9266-5bf2859062e4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:44.388148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-af7bd99b-41f5-4294-9266-5bf2859062e4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 28 01:13:44.389513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 509/1006] 10.222.0.16 () {56 vars in 1147 bytes} [Fri Jan 28 01:13:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:44.395753 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9a472-c922-47df-84de-8052ea8554cb None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:44.404651 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9a472-c922-47df-84de-8052ea8554cb None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:44.409084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d2add-e52d-408a-a7d5-14ea2d3ba66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:44.409877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d2add-e52d-408a-a7d5-14ea2d3ba66e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:44.410217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d2add-e52d-408a-a7d5-14ea2d3ba66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:44.410551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d2add-e52d-408a-a7d5-14ea2d3ba66e admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:44.411330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d2add-e52d-408a-a7d5-14ea2d3ba66e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:44.411690 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d2add-e52d-408a-a7d5-14ea2d3ba66e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:44.413357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d2add-e52d-408a-a7d5-14ea2d3ba66e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:44.418590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 498/1007] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jan 28 01:13:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:44.423998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd99b-41f5-4294-9266-5bf2859062e4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:44.433657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd99b-41f5-4294-9266-5bf2859062e4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:44.438092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490788af-0f64-4b93-abf2-068d76d42fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:44.438811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490788af-0f64-4b93-abf2-068d76d42fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:44.439095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490788af-0f64-4b93-abf2-068d76d42fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:44.439357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490788af-0f64-4b93-abf2-068d76d42fb4 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:44.440064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490788af-0f64-4b93-abf2-068d76d42fb4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:44.440364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490788af-0f64-4b93-abf2-068d76d42fb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:44.441977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490788af-0f64-4b93-abf2-068d76d42fb4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:44.446992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 510/1008] 10.222.0.16 () {56 vars in 1143 bytes} [Fri Jan 28 01:13:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:44.452500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d2add-e52d-408a-a7d5-14ea2d3ba66e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:44.462360 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d2add-e52d-408a-a7d5-14ea2d3ba66e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:44.467122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c51b-ea98-46da-88dd-85434e7a4fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:44.467759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c51b-ea98-46da-88dd-85434e7a4fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:44.468033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c51b-ea98-46da-88dd-85434e7a4fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:44.468302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c51b-ea98-46da-88dd-85434e7a4fe0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:44.469053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1c51b-ea98-46da-88dd-85434e7a4fe0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:44.470656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1c51b-ea98-46da-88dd-85434e7a4fe0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:44.487354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 499/1009] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Jan 28 01:13:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:13:45.169853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56715098-98a3-4af3-b89a-e1f49a71d762 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.170082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56715098-98a3-4af3-b89a-e1f49a71d762 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.170386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56715098-98a3-4af3-b89a-e1f49a71d762 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.172354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 511/1010] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:45.177647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72694e9c-30a3-4147-8d28-30d917ba455d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.177919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72694e9c-30a3-4147-8d28-30d917ba455d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.178217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72694e9c-30a3-4147-8d28-30d917ba455d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.196524 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-72694e9c-30a3-4147-8d28-30d917ba455d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:45.197732 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-72694e9c-30a3-4147-8d28-30d917ba455d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:45.215721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 500/1011] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:45 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:45.239173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56715098-98a3-4af3-b89a-e1f49a71d762 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:45.252193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56715098-98a3-4af3-b89a-e1f49a71d762 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:45.256946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cebfc-9169-42df-b64a-9bdb8d510b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:45.257799 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cebfc-9169-42df-b64a-9bdb8d510b31 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.258081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cebfc-9169-42df-b64a-9bdb8d510b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.258326 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cebfc-9169-42df-b64a-9bdb8d510b31 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.258995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cebfc-9169-42df-b64a-9bdb8d510b31 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:45.260588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cebfc-9169-42df-b64a-9bdb8d510b31 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:45.271862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-462cebfc-9169-42df-b64a-9bdb8d510b31 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:13:45.273842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 512/1012] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jan 28 01:13:45 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:45.279466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72694e9c-30a3-4147-8d28-30d917ba455d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:45.288657 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72694e9c-30a3-4147-8d28-30d917ba455d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:45.296196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f42e7-6ac3-4896-a534-43c1e628b679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:45.296856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f42e7-6ac3-4896-a534-43c1e628b679 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.297133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f42e7-6ac3-4896-a534-43c1e628b679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.297456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f42e7-6ac3-4896-a534-43c1e628b679 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.298186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f42e7-6ac3-4896-a534-43c1e628b679 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:45.298468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f42e7-6ac3-4896-a534-43c1e628b679 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:45.300218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f42e7-6ac3-4896-a534-43c1e628b679 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:45.307498 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 501/1013] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:45.311499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cebfc-9169-42df-b64a-9bdb8d510b31 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:45.322107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cebfc-9169-42df-b64a-9bdb8d510b31 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:45.327263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ab7ab-6ae0-43e6-92f3-e5793d612920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:45.327985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab7ab-6ae0-43e6-92f3-e5793d612920 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.328354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab7ab-6ae0-43e6-92f3-e5793d612920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.328710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab7ab-6ae0-43e6-92f3-e5793d612920 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.329554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ab7ab-6ae0-43e6-92f3-e5793d612920 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:45.329921 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ab7ab-6ae0-43e6-92f3-e5793d612920 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:45.331580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ab7ab-6ae0-43e6-92f3-e5793d612920 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:45.336999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 513/1014] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:45.343240 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f42e7-6ac3-4896-a534-43c1e628b679 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:45.353957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f42e7-6ac3-4896-a534-43c1e628b679 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:45.359182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3b020-f15d-43df-af24-f6cfe734d04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:45.359848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3b020-f15d-43df-af24-f6cfe734d04f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.360122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3b020-f15d-43df-af24-f6cfe734d04f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.360389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3b020-f15d-43df-af24-f6cfe734d04f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.361200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3b020-f15d-43df-af24-f6cfe734d04f admin admin] RBAC: Adding query filter params (interface=public, service_id=129bed5cf816439a82e9320f1ad76b73, region_id=RegionOne) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:45.361538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3b020-f15d-43df-af24-f6cfe734d04f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:45.363198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3b020-f15d-43df-af24-f6cfe734d04f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:45.369306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 502/1015] 10.222.0.16 () {56 vars in 1272 bytes} [Fri Jan 28 01:13:45 2022] GET /identity/v3/endpoints?service_id=129bed5cf816439a82e9320f1ad76b73&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:45.375431 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ab7ab-6ae0-43e6-92f3-e5793d612920 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:45.385504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ab7ab-6ae0-43e6-92f3-e5793d612920 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:45.390191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b4cde-ea8d-4000-94bd-3ef7df1d0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:45.390934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4cde-ea8d-4000-94bd-3ef7df1d0ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.391275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4cde-ea8d-4000-94bd-3ef7df1d0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.391608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b4cde-ea8d-4000-94bd-3ef7df1d0ce9 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.392380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b4cde-ea8d-4000-94bd-3ef7df1d0ce9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:45.394094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b4cde-ea8d-4000-94bd-3ef7df1d0ce9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:45.401006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 514/1016] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:13:45 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:13:45.602075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb235-78aa-44c6-bf31-bec771fd9aae None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.602267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb235-78aa-44c6-bf31-bec771fd9aae None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.602529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebb235-78aa-44c6-bf31-bec771fd9aae None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.604379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 503/1017] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:45.613523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909859fe-9169-48e0-a572-24fdbac8bea8 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.613938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909859fe-9169-48e0-a572-24fdbac8bea8 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.614195 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909859fe-9169-48e0-a572-24fdbac8bea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.632697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-909859fe-9169-48e0-a572-24fdbac8bea8 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:45.633912 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-909859fe-9169-48e0-a572-24fdbac8bea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:45.642292 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 515/1018] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:45 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:45.665633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebb235-78aa-44c6-bf31-bec771fd9aae None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:45.678428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebb235-78aa-44c6-bf31-bec771fd9aae None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:45.685414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273588a3-d5f7-4e71-a1f0-72182dfc0438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:45.686216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273588a3-d5f7-4e71-a1f0-72182dfc0438 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.686491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273588a3-d5f7-4e71-a1f0-72182dfc0438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.686757 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273588a3-d5f7-4e71-a1f0-72182dfc0438 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.687418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273588a3-d5f7-4e71-a1f0-72182dfc0438 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:45.689005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273588a3-d5f7-4e71-a1f0-72182dfc0438 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:45.700612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-273588a3-d5f7-4e71-a1f0-72182dfc0438 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 28 01:13:45.702872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 504/1019] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:45.708259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909859fe-9169-48e0-a572-24fdbac8bea8 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:45.717317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909859fe-9169-48e0-a572-24fdbac8bea8 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:45.721856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688faa45-71d4-4940-8191-38d1eedba6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:45.722946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688faa45-71d4-4940-8191-38d1eedba6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.723290 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688faa45-71d4-4940-8191-38d1eedba6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.723626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688faa45-71d4-4940-8191-38d1eedba6c5 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.724416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688faa45-71d4-4940-8191-38d1eedba6c5 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:45.724779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688faa45-71d4-4940-8191-38d1eedba6c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:45.726470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688faa45-71d4-4940-8191-38d1eedba6c5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:45.731576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 516/1020] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:45.737287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273588a3-d5f7-4e71-a1f0-72182dfc0438 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:45.747118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273588a3-d5f7-4e71-a1f0-72182dfc0438 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:45.751684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d124661-aa23-4b2d-ad83-9edfdbb61a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:45.752393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124661-aa23-4b2d-ad83-9edfdbb61a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.752662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124661-aa23-4b2d-ad83-9edfdbb61a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.752935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124661-aa23-4b2d-ad83-9edfdbb61a78 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.753674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d124661-aa23-4b2d-ad83-9edfdbb61a78 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:45.753972 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d124661-aa23-4b2d-ad83-9edfdbb61a78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:45.755598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d124661-aa23-4b2d-ad83-9edfdbb61a78 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:45.761599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 505/1021] 10.222.0.16 () {56 vars in 1133 bytes} [Fri Jan 28 01:13:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:45.766602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688faa45-71d4-4940-8191-38d1eedba6c5 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:45.776203 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688faa45-71d4-4940-8191-38d1eedba6c5 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:45.780814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ba1fa-39b0-4474-9d3a-dc29e261a0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:45.781560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba1fa-39b0-4474-9d3a-dc29e261a0ae admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:45.781908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba1fa-39b0-4474-9d3a-dc29e261a0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:45.782243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ba1fa-39b0-4474-9d3a-dc29e261a0ae admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:45.783066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba1fa-39b0-4474-9d3a-dc29e261a0ae admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:45.784652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ba1fa-39b0-4474-9d3a-dc29e261a0ae admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:45.804614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 517/1022] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Jan 28 01:13:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:46.681086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94a734-544e-4bc0-b346-8be59ff02602 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:46.681626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94a734-544e-4bc0-b346-8be59ff02602 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:46.681730 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94a734-544e-4bc0-b346-8be59ff02602 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:46.683528 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 506/1023] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:46.688940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41114c-731f-4229-901c-495356da85d7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:46.689390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41114c-731f-4229-901c-495356da85d7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:46.689704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41114c-731f-4229-901c-495356da85d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:46.707665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9e41114c-731f-4229-901c-495356da85d7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:46.708833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9e41114c-731f-4229-901c-495356da85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:46.726616 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 518/1024] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:46 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:46.750018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94a734-544e-4bc0-b346-8be59ff02602 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:46.762774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94a734-544e-4bc0-b346-8be59ff02602 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:46.767273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4774e-347e-4825-a48a-150cec82001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:46.768047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4774e-347e-4825-a48a-150cec82001d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:46.768316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4774e-347e-4825-a48a-150cec82001d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:46.768583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4774e-347e-4825-a48a-150cec82001d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:46.769785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4774e-347e-4825-a48a-150cec82001d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:46.771446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4774e-347e-4825-a48a-150cec82001d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:46.773144 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 507/1025] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:46.778686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41114c-731f-4229-901c-495356da85d7 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:46.787763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41114c-731f-4229-901c-495356da85d7 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:46.793045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0f892-761c-43ab-82cf-a8ada4dfa271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:46.793702 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0f892-761c-43ab-82cf-a8ada4dfa271 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:46.793978 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0f892-761c-43ab-82cf-a8ada4dfa271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:46.794229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0f892-761c-43ab-82cf-a8ada4dfa271 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:46.794972 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0f892-761c-43ab-82cf-a8ada4dfa271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:46.796878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0f892-761c-43ab-82cf-a8ada4dfa271 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:46.826640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 519/1026] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:13:46 2022] POST /identity/v3/projects => generated 311 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:47.608111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c2cb-4fb4-4df9-9cf8-ec9b6d3767dd None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:47.608367 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c2cb-4fb4-4df9-9cf8-ec9b6d3767dd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:47.608649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c2cb-4fb4-4df9-9cf8-ec9b6d3767dd None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:47.611904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 508/1027] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:47.616179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175efa9-0d69-4eae-928e-1307f9e0e3e6 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:47.616439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175efa9-0d69-4eae-928e-1307f9e0e3e6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:47.616742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175efa9-0d69-4eae-928e-1307f9e0e3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:47.638095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e175efa9-0d69-4eae-928e-1307f9e0e3e6 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:47.639492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e175efa9-0d69-4eae-928e-1307f9e0e3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:47.697277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 520/1028] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:47 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:47.719359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5c2cb-4fb4-4df9-9cf8-ec9b6d3767dd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:47.731768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5c2cb-4fb4-4df9-9cf8-ec9b6d3767dd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:47.736026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c28a4-102f-4d0a-9e42-4989db4838e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:47.736809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c28a4-102f-4d0a-9e42-4989db4838e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:47.737085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c28a4-102f-4d0a-9e42-4989db4838e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:47.737413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c28a4-102f-4d0a-9e42-4989db4838e5 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:47.738074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c28a4-102f-4d0a-9e42-4989db4838e5 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:47.739732 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c28a4-102f-4d0a-9e42-4989db4838e5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:47.750703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c17c28a4-102f-4d0a-9e42-4989db4838e5 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 28 01:13:47.752044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 509/1029] 10.222.0.16 () {56 vars in 1126 bytes} [Fri Jan 28 01:13:47 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:47.757954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175efa9-0d69-4eae-928e-1307f9e0e3e6 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:47.767282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175efa9-0d69-4eae-928e-1307f9e0e3e6 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:47.772305 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545029-b70b-4162-b7f8-4b19b50603d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:47.772955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545029-b70b-4162-b7f8-4b19b50603d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:47.773207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545029-b70b-4162-b7f8-4b19b50603d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:47.773547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545029-b70b-4162-b7f8-4b19b50603d0 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:47.774259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77545029-b70b-4162-b7f8-4b19b50603d0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:47.774562 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77545029-b70b-4162-b7f8-4b19b50603d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:47.776140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77545029-b70b-4162-b7f8-4b19b50603d0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:47.781193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 521/1030] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:47.786431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c28a4-102f-4d0a-9e42-4989db4838e5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:47.796744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c28a4-102f-4d0a-9e42-4989db4838e5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:47.801685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630923f-5e63-47fe-bf68-d08ed83cdd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:47.802326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630923f-5e63-47fe-bf68-d08ed83cdd55 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:47.802601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630923f-5e63-47fe-bf68-d08ed83cdd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:47.802863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630923f-5e63-47fe-bf68-d08ed83cdd55 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:47.803576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630923f-5e63-47fe-bf68-d08ed83cdd55 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:47.803885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630923f-5e63-47fe-bf68-d08ed83cdd55 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:47.805473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630923f-5e63-47fe-bf68-d08ed83cdd55 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:47.810766 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 510/1031] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:47.816266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545029-b70b-4162-b7f8-4b19b50603d0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:47.826370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545029-b70b-4162-b7f8-4b19b50603d0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:47.831231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ace0d-0f8e-48c8-8bf5-8c9602ac7b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:47.831904 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ace0d-0f8e-48c8-8bf5-8c9602ac7b91 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:47.832180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ace0d-0f8e-48c8-8bf5-8c9602ac7b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:47.832445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ace0d-0f8e-48c8-8bf5-8c9602ac7b91 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:47.833264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ace0d-0f8e-48c8-8bf5-8c9602ac7b91 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:47.834939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ace0d-0f8e-48c8-8bf5-8c9602ac7b91 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:47.859641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 522/1032] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Jan 28 01:13:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:48.080172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b56b5-6e05-4021-907d-5faa0c988265 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.080570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b56b5-6e05-4021-907d-5faa0c988265 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.080702 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b56b5-6e05-4021-907d-5faa0c988265 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.082512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 511/1033] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:48.087923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6306-c8a5-43d0-b7e6-889147470164 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.088208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6306-c8a5-43d0-b7e6-889147470164 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.088485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6306-c8a5-43d0-b7e6-889147470164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.106539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ee2d6306-c8a5-43d0-b7e6-889147470164 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:48.107714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ee2d6306-c8a5-43d0-b7e6-889147470164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:48.125967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 523/1034] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:48.149269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b56b5-6e05-4021-907d-5faa0c988265 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.162417 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b56b5-6e05-4021-907d-5faa0c988265 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.167201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dda2b-60c4-4b92-86a3-273fb247ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.168112 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dda2b-60c4-4b92-86a3-273fb247ff81 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.168389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dda2b-60c4-4b92-86a3-273fb247ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.168658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dda2b-60c4-4b92-86a3-273fb247ff81 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.179762 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dda2b-60c4-4b92-86a3-273fb247ff81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:48.187028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-d24dda2b-60c4-4b92-86a3-273fb247ff81 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:13:48.188425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 512/1035] 10.222.0.16 () {56 vars in 1141 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:48.194761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d6306-c8a5-43d0-b7e6-889147470164 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.204208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d6306-c8a5-43d0-b7e6-889147470164 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.210083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673bef8-bffe-43b0-804e-41f653491337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.210809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673bef8-bffe-43b0-804e-41f653491337 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.211143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673bef8-bffe-43b0-804e-41f653491337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.211460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673bef8-bffe-43b0-804e-41f653491337 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.212293 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673bef8-bffe-43b0-804e-41f653491337 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:48.212649 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673bef8-bffe-43b0-804e-41f653491337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.214379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673bef8-bffe-43b0-804e-41f653491337 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.223615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 524/1036] 10.222.0.16 () {56 vars in 1136 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:48.229318 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dda2b-60c4-4b92-86a3-273fb247ff81 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.240094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dda2b-60c4-4b92-86a3-273fb247ff81 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.245415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3122f-48ab-4bf9-89ee-fcd990a1ea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.246335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3122f-48ab-4bf9-89ee-fcd990a1ea70 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.246672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3122f-48ab-4bf9-89ee-fcd990a1ea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.246947 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3122f-48ab-4bf9-89ee-fcd990a1ea70 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.257192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3122f-48ab-4bf9-89ee-fcd990a1ea70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.259034 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3122f-48ab-4bf9-89ee-fcd990a1ea70 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.281676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-aab3122f-48ab-4bf9-89ee-fcd990a1ea70 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:48.288070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 513/1037] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:48.289852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673bef8-bffe-43b0-804e-41f653491337 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.300625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673bef8-bffe-43b0-804e-41f653491337 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.305991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07310459-1537-4896-aecf-3543b5203479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.306738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07310459-1537-4896-aecf-3543b5203479 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.307078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07310459-1537-4896-aecf-3543b5203479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.307414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07310459-1537-4896-aecf-3543b5203479 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.308222 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07310459-1537-4896-aecf-3543b5203479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:48.308605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07310459-1537-4896-aecf-3543b5203479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.310309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07310459-1537-4896-aecf-3543b5203479 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.323059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 525/1038] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:48.328836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3122f-48ab-4bf9-89ee-fcd990a1ea70 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.339121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3122f-48ab-4bf9-89ee-fcd990a1ea70 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.344974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62975d11-502e-4184-94ea-8b18153d18b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.345856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62975d11-502e-4184-94ea-8b18153d18b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.346194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62975d11-502e-4184-94ea-8b18153d18b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.346519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62975d11-502e-4184-94ea-8b18153d18b0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.355269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62975d11-502e-4184-94ea-8b18153d18b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.357337 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62975d11-502e-4184-94ea-8b18153d18b0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.371376 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-62975d11-502e-4184-94ea-8b18153d18b0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:13:48.372764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 514/1039] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:48.378676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07310459-1537-4896-aecf-3543b5203479 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.388690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07310459-1537-4896-aecf-3543b5203479 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.393773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc2eb2-5362-4e6a-9e47-85a58b9e47b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.394482 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc2eb2-5362-4e6a-9e47-85a58b9e47b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.394779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc2eb2-5362-4e6a-9e47-85a58b9e47b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.395046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc2eb2-5362-4e6a-9e47-85a58b9e47b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.395894 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc2eb2-5362-4e6a-9e47-85a58b9e47b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:48.396192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc2eb2-5362-4e6a-9e47-85a58b9e47b7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.398064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc2eb2-5362-4e6a-9e47-85a58b9e47b7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.415718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 526/1040] 10.222.0.16 () {56 vars in 1154 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:48.421708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62975d11-502e-4184-94ea-8b18153d18b0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.431499 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62975d11-502e-4184-94ea-8b18153d18b0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.436279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ce6ec-be02-4e93-b3bc-e0d783cdab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.436906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ce6ec-be02-4e93-b3bc-e0d783cdab22 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.437181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ce6ec-be02-4e93-b3bc-e0d783cdab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.437480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ce6ec-be02-4e93-b3bc-e0d783cdab22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.445293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ce6ec-be02-4e93-b3bc-e0d783cdab22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.447214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ce6ec-be02-4e93-b3bc-e0d783cdab22 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.455998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 515/1041] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:13:48.461945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc2eb2-5362-4e6a-9e47-85a58b9e47b7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.472783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc2eb2-5362-4e6a-9e47-85a58b9e47b7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.477702 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4c7bc-11b3-4f10-9f7c-6e20b026d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.478594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4c7bc-11b3-4f10-9f7c-6e20b026d2ff admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.478938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4c7bc-11b3-4f10-9f7c-6e20b026d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.479276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4c7bc-11b3-4f10-9f7c-6e20b026d2ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.490062 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4c7bc-11b3-4f10-9f7c-6e20b026d2ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.491894 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4c7bc-11b3-4f10-9f7c-6e20b026d2ff admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.509914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-4db4c7bc-11b3-4f10-9f7c-6e20b026d2ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:48.511346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 527/1042] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:48.516949 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ce6ec-be02-4e93-b3bc-e0d783cdab22 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.526360 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ce6ec-be02-4e93-b3bc-e0d783cdab22 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.532297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af089d11-aa5b-4ec6-bf45-9a725fd73c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.533044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af089d11-aa5b-4ec6-bf45-9a725fd73c4e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.533397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af089d11-aa5b-4ec6-bf45-9a725fd73c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.533723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af089d11-aa5b-4ec6-bf45-9a725fd73c4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.534525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af089d11-aa5b-4ec6-bf45-9a725fd73c4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:48.534884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af089d11-aa5b-4ec6-bf45-9a725fd73c4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.536510 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af089d11-aa5b-4ec6-bf45-9a725fd73c4e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.548683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 516/1043] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:48.554487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4c7bc-11b3-4f10-9f7c-6e20b026d2ff admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.564368 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4c7bc-11b3-4f10-9f7c-6e20b026d2ff admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.568922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316b9a1-f242-4d88-9735-2ca5345d1d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.569736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316b9a1-f242-4d88-9735-2ca5345d1d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.570015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316b9a1-f242-4d88-9735-2ca5345d1d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.570283 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316b9a1-f242-4d88-9735-2ca5345d1d89 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.577594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316b9a1-f242-4d88-9735-2ca5345d1d89 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.579532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316b9a1-f242-4d88-9735-2ca5345d1d89 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.592331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-5316b9a1-f242-4d88-9735-2ca5345d1d89 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:48.593780 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 528/1044] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:48.599720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af089d11-aa5b-4ec6-bf45-9a725fd73c4e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.612244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af089d11-aa5b-4ec6-bf45-9a725fd73c4e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.617073 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbce61-0ae9-4a01-88fe-a071bf8a266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.617762 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbce61-0ae9-4a01-88fe-a071bf8a266e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.618041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbce61-0ae9-4a01-88fe-a071bf8a266e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.618313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbce61-0ae9-4a01-88fe-a071bf8a266e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.619111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbce61-0ae9-4a01-88fe-a071bf8a266e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:48.619409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbce61-0ae9-4a01-88fe-a071bf8a266e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.621379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbce61-0ae9-4a01-88fe-a071bf8a266e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.638384 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 517/1045] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:48.644223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316b9a1-f242-4d88-9735-2ca5345d1d89 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:48.655201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316b9a1-f242-4d88-9735-2ca5345d1d89 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:48.661824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5acf8-a11a-4a3a-9a81-ea0a47bda879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:48.662763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5acf8-a11a-4a3a-9a81-ea0a47bda879 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:48.663194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5acf8-a11a-4a3a-9a81-ea0a47bda879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:48.663602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5acf8-a11a-4a3a-9a81-ea0a47bda879 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:48.664837 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5acf8-a11a-4a3a-9a81-ea0a47bda879 admin admin] RBAC: Adding query filter params (role.id=6c1451150c314b4b9938ad823b9a6512, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=43dd173265f24c69af4b13b61722eb51) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:48.665365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5acf8-a11a-4a3a-9a81-ea0a47bda879 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:48.668306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5acf8-a11a-4a3a-9a81-ea0a47bda879 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:48.677469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 529/1046] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:48 2022] GET /identity/v3/role_assignments?user.id=43dd173265f24c69af4b13b61722eb51&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=6c1451150c314b4b9938ad823b9a6512 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:49.079518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfc95-2c06-4093-a56f-9d587ee98477 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:49.080066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfc95-2c06-4093-a56f-9d587ee98477 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:49.080066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badfc95-2c06-4093-a56f-9d587ee98477 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:49.081887 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 518/1047] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:49.087249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c9cad-9395-45c4-be10-af0c14283069 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:49.087700 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c9cad-9395-45c4-be10-af0c14283069 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:49.087785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c9cad-9395-45c4-be10-af0c14283069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:49.105645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-7c0c9cad-9395-45c4-be10-af0c14283069 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:49.106796 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7c0c9cad-9395-45c4-be10-af0c14283069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:49.115063 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 530/1048] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:49.139327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badfc95-2c06-4093-a56f-9d587ee98477 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:49.151968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badfc95-2c06-4093-a56f-9d587ee98477 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:49.156405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ed159-25fd-43e7-9e0f-dae64c1dea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:49.157278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ed159-25fd-43e7-9e0f-dae64c1dea7d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:49.157564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ed159-25fd-43e7-9e0f-dae64c1dea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:49.157831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ed159-25fd-43e7-9e0f-dae64c1dea7d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:49.159085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ed159-25fd-43e7-9e0f-dae64c1dea7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:49.160757 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ed159-25fd-43e7-9e0f-dae64c1dea7d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:49.162639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 519/1049] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:49.167791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c9cad-9395-45c4-be10-af0c14283069 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:49.176772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c9cad-9395-45c4-be10-af0c14283069 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:49.181876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a964312-9903-47d8-a489-e6579b2bcd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:49.182586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a964312-9903-47d8-a489-e6579b2bcd8d admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:49.182959 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a964312-9903-47d8-a489-e6579b2bcd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:49.183371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a964312-9903-47d8-a489-e6579b2bcd8d admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:49.184172 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a964312-9903-47d8-a489-e6579b2bcd8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:49.186153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a964312-9903-47d8-a489-e6579b2bcd8d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:49.206224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 531/1050] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:13:49 2022] POST /identity/v3/users => generated 285 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:13:50.080212 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8ddcb-edd7-420c-98f6-a6b7e18270f0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:50.080779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8ddcb-edd7-420c-98f6-a6b7e18270f0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:50.080779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8ddcb-edd7-420c-98f6-a6b7e18270f0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:50.082584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 520/1051] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:50.088005 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e633b-e86b-41e4-b884-ccf31f9e64ed None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:50.088414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e633b-e86b-41e4-b884-ccf31f9e64ed None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:50.088616 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e633b-e86b-41e4-b884-ccf31f9e64ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:50.107531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-021e633b-e86b-41e4-b884-ccf31f9e64ed None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:50.108721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-021e633b-e86b-41e4-b884-ccf31f9e64ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:50.116894 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 532/1052] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:50.139559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8ddcb-edd7-420c-98f6-a6b7e18270f0 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:50.153752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a8ddcb-edd7-420c-98f6-a6b7e18270f0 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:50.158547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28aa3d-443e-491d-af81-e7e300edca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:50.159186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28aa3d-443e-491d-af81-e7e300edca74 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:50.159464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28aa3d-443e-491d-af81-e7e300edca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:50.159730 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28aa3d-443e-491d-af81-e7e300edca74 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:50.170045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28aa3d-443e-491d-af81-e7e300edca74 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:50.171782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28aa3d-443e-491d-af81-e7e300edca74 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:50.180857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 521/1053] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:50 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:13:50.186668 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e633b-e86b-41e4-b884-ccf31f9e64ed None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:50.195706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e633b-e86b-41e4-b884-ccf31f9e64ed None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:50.200649 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4457ce-ace9-4d6c-ba77-cd6f747ce69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:50.201451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4457ce-ace9-4d6c-ba77-cd6f747ce69a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:50.201724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4457ce-ace9-4d6c-ba77-cd6f747ce69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:50.201965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4457ce-ace9-4d6c-ba77-cd6f747ce69a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:50.203191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4457ce-ace9-4d6c-ba77-cd6f747ce69a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:50.204866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4457ce-ace9-4d6c-ba77-cd6f747ce69a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:50.206638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 533/1054] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:50.841168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151277a6-cfc8-4f52-aeac-9aba3fbffcc5 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:50.841482 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151277a6-cfc8-4f52-aeac-9aba3fbffcc5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:50.841753 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151277a6-cfc8-4f52-aeac-9aba3fbffcc5 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:50.843555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 522/1055] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:50.849258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098b397-977d-49e0-8f6c-0cfbc703d3e0 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:50.849570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098b397-977d-49e0-8f6c-0cfbc703d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:50.849838 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098b397-977d-49e0-8f6c-0cfbc703d3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:50.867693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9098b397-977d-49e0-8f6c-0cfbc703d3e0 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:50.868850 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9098b397-977d-49e0-8f6c-0cfbc703d3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:50.876929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 534/1056] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:50.900365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151277a6-cfc8-4f52-aeac-9aba3fbffcc5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:50.913892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151277a6-cfc8-4f52-aeac-9aba3fbffcc5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:50.919031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28799e-3090-4b28-820f-1ba14188fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:50.919824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28799e-3090-4b28-820f-1ba14188fbef admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:50.920101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28799e-3090-4b28-820f-1ba14188fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:50.920369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28799e-3090-4b28-820f-1ba14188fbef admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:50.931502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28799e-3090-4b28-820f-1ba14188fbef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:50.938675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-bc28799e-3090-4b28-820f-1ba14188fbef admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:13:50.939798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 523/1057] 10.222.0.16 () {56 vars in 1141 bytes} [Fri Jan 28 01:13:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:50.945844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098b397-977d-49e0-8f6c-0cfbc703d3e0 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:50.955030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098b397-977d-49e0-8f6c-0cfbc703d3e0 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:50.961028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5054156-39ee-4b00-a310-d53cf18f517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:50.961724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5054156-39ee-4b00-a310-d53cf18f517d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:50.962000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5054156-39ee-4b00-a310-d53cf18f517d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:50.962271 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5054156-39ee-4b00-a310-d53cf18f517d admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:50.963106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5054156-39ee-4b00-a310-d53cf18f517d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:50.963408 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5054156-39ee-4b00-a310-d53cf18f517d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:50.965312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5054156-39ee-4b00-a310-d53cf18f517d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:50.974355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 535/1058] 10.222.0.16 () {56 vars in 1136 bytes} [Fri Jan 28 01:13:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:50.980085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28799e-3090-4b28-820f-1ba14188fbef admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:50.990954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28799e-3090-4b28-820f-1ba14188fbef admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:50.995629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce6ddd-74a3-4f1c-af18-ca231dffe0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:50.996418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce6ddd-74a3-4f1c-af18-ca231dffe0dc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:50.996695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce6ddd-74a3-4f1c-af18-ca231dffe0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:50.996968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce6ddd-74a3-4f1c-af18-ca231dffe0dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.008217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce6ddd-74a3-4f1c-af18-ca231dffe0dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.010133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce6ddd-74a3-4f1c-af18-ca231dffe0dc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.027609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-52ce6ddd-74a3-4f1c-af18-ca231dffe0dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:51.028800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 524/1059] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:51.034607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5054156-39ee-4b00-a310-d53cf18f517d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.044999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5054156-39ee-4b00-a310-d53cf18f517d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.050665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fd440-a598-41ef-97b4-2e5e0d21c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.051312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd440-a598-41ef-97b4-2e5e0d21c1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.051592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd440-a598-41ef-97b4-2e5e0d21c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.051858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd440-a598-41ef-97b4-2e5e0d21c1f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.052587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fd440-a598-41ef-97b4-2e5e0d21c1f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:51.052889 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fd440-a598-41ef-97b4-2e5e0d21c1f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.054495 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fd440-a598-41ef-97b4-2e5e0d21c1f3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.066718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 536/1060] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:51.072405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce6ddd-74a3-4f1c-af18-ca231dffe0dc admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.082998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce6ddd-74a3-4f1c-af18-ca231dffe0dc admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.088743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90f167-ca1e-48ef-bdaa-3bb4706d1659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.089560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90f167-ca1e-48ef-bdaa-3bb4706d1659 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.089834 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90f167-ca1e-48ef-bdaa-3bb4706d1659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.090103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90f167-ca1e-48ef-bdaa-3bb4706d1659 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.098392 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90f167-ca1e-48ef-bdaa-3bb4706d1659 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.100398 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90f167-ca1e-48ef-bdaa-3bb4706d1659 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.115044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-0e90f167-ca1e-48ef-bdaa-3bb4706d1659 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:13:51.116168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 525/1061] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:51.122137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fd440-a598-41ef-97b4-2e5e0d21c1f3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.132477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fd440-a598-41ef-97b4-2e5e0d21c1f3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.138433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef65678-f540-490c-bf6f-3ef28e52fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.139095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef65678-f540-490c-bf6f-3ef28e52fdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.139370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef65678-f540-490c-bf6f-3ef28e52fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.139636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef65678-f540-490c-bf6f-3ef28e52fdd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.140484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef65678-f540-490c-bf6f-3ef28e52fdd8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:51.140785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef65678-f540-490c-bf6f-3ef28e52fdd8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.142704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef65678-f540-490c-bf6f-3ef28e52fdd8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.161031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 537/1062] 10.222.0.16 () {56 vars in 1154 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:51.166929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90f167-ca1e-48ef-bdaa-3bb4706d1659 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.177198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90f167-ca1e-48ef-bdaa-3bb4706d1659 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.182512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bcbc7-6516-4672-88ec-b90c15c5a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.183276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bcbc7-6516-4672-88ec-b90c15c5a352 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.183543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bcbc7-6516-4672-88ec-b90c15c5a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.183805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bcbc7-6516-4672-88ec-b90c15c5a352 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.194562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bcbc7-6516-4672-88ec-b90c15c5a352 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.196387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bcbc7-6516-4672-88ec-b90c15c5a352 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.213161 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-a46bcbc7-6516-4672-88ec-b90c15c5a352 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:51.214343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 526/1063] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:51.220117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef65678-f540-490c-bf6f-3ef28e52fdd8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.230765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef65678-f540-490c-bf6f-3ef28e52fdd8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.235974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e58cf6-603a-4c9d-b2bb-319b2d18fbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.236664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e58cf6-603a-4c9d-b2bb-319b2d18fbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.236937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e58cf6-603a-4c9d-b2bb-319b2d18fbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.237198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e58cf6-603a-4c9d-b2bb-319b2d18fbc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.237970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e58cf6-603a-4c9d-b2bb-319b2d18fbc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:51.238266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e58cf6-603a-4c9d-b2bb-319b2d18fbc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.239914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e58cf6-603a-4c9d-b2bb-319b2d18fbc9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.253089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 538/1064] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:51.258929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bcbc7-6516-4672-88ec-b90c15c5a352 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.269108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bcbc7-6516-4672-88ec-b90c15c5a352 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.274060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19325d71-e43f-4c43-be21-51cb81078b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.274835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19325d71-e43f-4c43-be21-51cb81078b9a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.275082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19325d71-e43f-4c43-be21-51cb81078b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.275379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19325d71-e43f-4c43-be21-51cb81078b9a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.282261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19325d71-e43f-4c43-be21-51cb81078b9a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.284188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19325d71-e43f-4c43-be21-51cb81078b9a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.296790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-19325d71-e43f-4c43-be21-51cb81078b9a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:51.298198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 527/1065] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:51.303910 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e58cf6-603a-4c9d-b2bb-319b2d18fbc9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.313956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e58cf6-603a-4c9d-b2bb-319b2d18fbc9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.318842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bae8b-e0aa-4e51-bd87-82a44b2a8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.319475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bae8b-e0aa-4e51-bd87-82a44b2a8584 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.319752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bae8b-e0aa-4e51-bd87-82a44b2a8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.320021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bae8b-e0aa-4e51-bd87-82a44b2a8584 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.320799 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bae8b-e0aa-4e51-bd87-82a44b2a8584 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:51.321096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bae8b-e0aa-4e51-bd87-82a44b2a8584 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.322960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bae8b-e0aa-4e51-bd87-82a44b2a8584 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.334817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 539/1066] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:51.340675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19325d71-e43f-4c43-be21-51cb81078b9a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.351583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19325d71-e43f-4c43-be21-51cb81078b9a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.356298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e0850-0af0-4e4d-bd12-5d5998a04cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.357148 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e0850-0af0-4e4d-bd12-5d5998a04cae admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.357447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e0850-0af0-4e4d-bd12-5d5998a04cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.357712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e0850-0af0-4e4d-bd12-5d5998a04cae admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/43dd173265f24c69af4b13b61722eb51/roles/6c1451150c314b4b9938ad823b9a6512` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.360060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e0850-0af0-4e4d-bd12-5d5998a04cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=43dd173265f24c69af4b13b61722eb51, role_id=6c1451150c314b4b9938ad823b9a6512)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.362687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e0850-0af0-4e4d-bd12-5d5998a04cae admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.376491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 528/1067] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:51 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/43dd173265f24c69af4b13b61722eb51/roles/6c1451150c314b4b9938ad823b9a6512 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:51.489036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2b62-5967-403a-a6a8-330a1bd404ec None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.489266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2b62-5967-403a-a6a8-330a1bd404ec None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.489663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a2b62-5967-403a-a6a8-330a1bd404ec None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.491544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 540/1068] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:51.498242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d03e4-2189-40d9-a228-4d94c2a7526a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.499326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d03e4-2189-40d9-a228-4d94c2a7526a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.499725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d03e4-2189-40d9-a228-4d94c2a7526a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.520555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-707d03e4-2189-40d9-a228-4d94c2a7526a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:51.521822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-707d03e4-2189-40d9-a228-4d94c2a7526a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:51.585146 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 529/1069] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:51.610145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a2b62-5967-403a-a6a8-330a1bd404ec None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.623122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a2b62-5967-403a-a6a8-330a1bd404ec None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.627878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cac2e-609d-4b14-882b-ae31e6269498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.628684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cac2e-609d-4b14-882b-ae31e6269498 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.628964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cac2e-609d-4b14-882b-ae31e6269498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.629252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cac2e-609d-4b14-882b-ae31e6269498 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.640215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cac2e-609d-4b14-882b-ae31e6269498 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:51.647074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-2a7cac2e-609d-4b14-882b-ae31e6269498 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:13:51.648267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 541/1070] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:51.654790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d03e4-2189-40d9-a228-4d94c2a7526a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.664246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d03e4-2189-40d9-a228-4d94c2a7526a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.670316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a346b45-bef8-415a-85f4-e9abb460247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.670975 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a346b45-bef8-415a-85f4-e9abb460247b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.671249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a346b45-bef8-415a-85f4-e9abb460247b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.671514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a346b45-bef8-415a-85f4-e9abb460247b admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.672272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a346b45-bef8-415a-85f4-e9abb460247b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:51.672581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a346b45-bef8-415a-85f4-e9abb460247b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.674287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a346b45-bef8-415a-85f4-e9abb460247b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.683167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 530/1071] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:51.689043 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cac2e-609d-4b14-882b-ae31e6269498 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.699660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cac2e-609d-4b14-882b-ae31e6269498 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.705077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eca4b-77b7-44cb-965f-2be867711819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.705966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eca4b-77b7-44cb-965f-2be867711819 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.706240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eca4b-77b7-44cb-965f-2be867711819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.706505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308eca4b-77b7-44cb-965f-2be867711819 admin admin] PATH_INFO: `/v3/users/12c9b14fb57a4010b503c846b5e84a9f` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.720352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eca4b-77b7-44cb-965f-2be867711819 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c9b14fb57a4010b503c846b5e84a9f)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.722881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308eca4b-77b7-44cb-965f-2be867711819 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.724568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 542/1072] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/users/12c9b14fb57a4010b503c846b5e84a9f => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:51.730327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a346b45-bef8-415a-85f4-e9abb460247b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.740205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a346b45-bef8-415a-85f4-e9abb460247b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.745062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a45de7-98a1-4f41-80b9-a37d22d32318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.745791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a45de7-98a1-4f41-80b9-a37d22d32318 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.746079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a45de7-98a1-4f41-80b9-a37d22d32318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.746344 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a45de7-98a1-4f41-80b9-a37d22d32318 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.754136 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a45de7-98a1-4f41-80b9-a37d22d32318 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.755864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a45de7-98a1-4f41-80b9-a37d22d32318 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.764693 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 531/1073] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:13:51.770387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eca4b-77b7-44cb-965f-2be867711819 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.781522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308eca4b-77b7-44cb-965f-2be867711819 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.787355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91edb59-7266-4afb-a565-d06c2176a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.788214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91edb59-7266-4afb-a565-d06c2176a7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.788487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91edb59-7266-4afb-a565-d06c2176a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.788757 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91edb59-7266-4afb-a565-d06c2176a7f4 admin admin] PATH_INFO: `/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.790034 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91edb59-7266-4afb-a565-d06c2176a7f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b89e1e18d944de5b3e3db1a7f4b715d)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.792069 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91edb59-7266-4afb-a565-d06c2176a7f4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.793825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 543/1074] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:51.800248 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a45de7-98a1-4f41-80b9-a37d22d32318 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:51.809641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a45de7-98a1-4f41-80b9-a37d22d32318 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:51.814853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a891a4-b090-4ccb-a6b1-2b01f2cfe345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:51.815486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a891a4-b090-4ccb-a6b1-2b01f2cfe345 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:51.815767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a891a4-b090-4ccb-a6b1-2b01f2cfe345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:51.816040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a891a4-b090-4ccb-a6b1-2b01f2cfe345 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:51.816885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a891a4-b090-4ccb-a6b1-2b01f2cfe345 admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=0b89e1e18d944de5b3e3db1a7f4b715d, user.id=12c9b14fb57a4010b503c846b5e84a9f) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:51.817192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a891a4-b090-4ccb-a6b1-2b01f2cfe345 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:51.819043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a891a4-b090-4ccb-a6b1-2b01f2cfe345 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:51.825511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 532/1075] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:51 2022] GET /identity/v3/role_assignments?user.id=12c9b14fb57a4010b503c846b5e84a9f&scope.project.id=0b89e1e18d944de5b3e3db1a7f4b715d&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:53.540375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fece626-d406-4a73-a62d-7baaf768b1ca None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.541044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fece626-d406-4a73-a62d-7baaf768b1ca None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.541044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fece626-d406-4a73-a62d-7baaf768b1ca None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.542822 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 544/1076] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:53.548440 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1b60-0394-463b-859a-cc8def280648 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.548869 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1b60-0394-463b-859a-cc8def280648 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.548964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e1b60-0394-463b-859a-cc8def280648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.568228 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d56e1b60-0394-463b-859a-cc8def280648 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:53.569444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d56e1b60-0394-463b-859a-cc8def280648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:53.578991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 533/1077] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:53.603241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fece626-d406-4a73-a62d-7baaf768b1ca None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:53.617409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fece626-d406-4a73-a62d-7baaf768b1ca None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:53.622566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa0d08-4717-44d4-95b9-43e4d62539b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:53.623377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa0d08-4717-44d4-95b9-43e4d62539b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.623631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa0d08-4717-44d4-95b9-43e4d62539b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.623918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa0d08-4717-44d4-95b9-43e4d62539b3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.635339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa0d08-4717-44d4-95b9-43e4d62539b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:53.642802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-0daa0d08-4717-44d4-95b9-43e4d62539b3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 28 01:13:53.644220 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 545/1078] 10.222.0.16 () {56 vars in 1141 bytes} [Fri Jan 28 01:13:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:53.650176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e1b60-0394-463b-859a-cc8def280648 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:53.659608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e1b60-0394-463b-859a-cc8def280648 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:53.665421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f8aec-d18a-44a3-83fc-aec858d29fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:53.666075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f8aec-d18a-44a3-83fc-aec858d29fff admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.666350 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f8aec-d18a-44a3-83fc-aec858d29fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.666617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f8aec-d18a-44a3-83fc-aec858d29fff admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.667507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f8aec-d18a-44a3-83fc-aec858d29fff admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:53.667809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f8aec-d18a-44a3-83fc-aec858d29fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:53.669431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f8aec-d18a-44a3-83fc-aec858d29fff admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:53.678087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 534/1079] 10.222.0.16 () {56 vars in 1136 bytes} [Fri Jan 28 01:13:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:53.683878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa0d08-4717-44d4-95b9-43e4d62539b3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:53.695001 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa0d08-4717-44d4-95b9-43e4d62539b3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:53.700896 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467211cc-263a-4330-953c-ad7414cd28ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:53.701713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467211cc-263a-4330-953c-ad7414cd28ac admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.701992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467211cc-263a-4330-953c-ad7414cd28ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.702260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467211cc-263a-4330-953c-ad7414cd28ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.713333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467211cc-263a-4330-953c-ad7414cd28ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:53.715326 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467211cc-263a-4330-953c-ad7414cd28ac admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:53.734091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-467211cc-263a-4330-953c-ad7414cd28ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:53.735395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 546/1080] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:53.742037 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f8aec-d18a-44a3-83fc-aec858d29fff admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:53.752985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f8aec-d18a-44a3-83fc-aec858d29fff admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:53.759103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a81a1-7ace-4d8b-b3ee-2401a04e7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:53.759761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a81a1-7ace-4d8b-b3ee-2401a04e7e6b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.760036 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a81a1-7ace-4d8b-b3ee-2401a04e7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.760270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a81a1-7ace-4d8b-b3ee-2401a04e7e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.761017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a81a1-7ace-4d8b-b3ee-2401a04e7e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:53.761357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a81a1-7ace-4d8b-b3ee-2401a04e7e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:53.762956 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a81a1-7ace-4d8b-b3ee-2401a04e7e6b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:53.775560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 535/1081] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:53.781615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467211cc-263a-4330-953c-ad7414cd28ac admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:53.792074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467211cc-263a-4330-953c-ad7414cd28ac admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:53.797857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa9752-5602-4ef9-9d34-4807bef970c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:53.798639 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa9752-5602-4ef9-9d34-4807bef970c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.798916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa9752-5602-4ef9-9d34-4807bef970c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.799182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa9752-5602-4ef9-9d34-4807bef970c2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.806946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa9752-5602-4ef9-9d34-4807bef970c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:53.809066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa9752-5602-4ef9-9d34-4807bef970c2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:53.822760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-e0fa9752-5602-4ef9-9d34-4807bef970c2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 28 01:13:53.824128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 547/1082] 10.222.0.16 () {56 vars in 1114 bytes} [Fri Jan 28 01:13:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:53.830001 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a81a1-7ace-4d8b-b3ee-2401a04e7e6b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:53.840499 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a81a1-7ace-4d8b-b3ee-2401a04e7e6b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:53.846352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4c2f-54cc-4017-9470-18f3bae518b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:53.847452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4c2f-54cc-4017-9470-18f3bae518b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.847810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4c2f-54cc-4017-9470-18f3bae518b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.848141 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4c2f-54cc-4017-9470-18f3bae518b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.849048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea4c2f-54cc-4017-9470-18f3bae518b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:53.849445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea4c2f-54cc-4017-9470-18f3bae518b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:53.851340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea4c2f-54cc-4017-9470-18f3bae518b6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:53.869478 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 536/1083] 10.222.0.16 () {56 vars in 1154 bytes} [Fri Jan 28 01:13:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:53.875476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa9752-5602-4ef9-9d34-4807bef970c2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:53.886320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa9752-5602-4ef9-9d34-4807bef970c2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:53.892147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00df33-2842-4555-a816-1c7be176412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:53.892786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00df33-2842-4555-a816-1c7be176412a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.893061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00df33-2842-4555-a816-1c7be176412a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.893369 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00df33-2842-4555-a816-1c7be176412a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.901033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00df33-2842-4555-a816-1c7be176412a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:53.902872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00df33-2842-4555-a816-1c7be176412a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:53.911507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 548/1084] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:13:53.917536 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4c2f-54cc-4017-9470-18f3bae518b6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:53.927751 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4c2f-54cc-4017-9470-18f3bae518b6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:53.932729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccb875-acc0-4ea2-9788-7dd4358c6816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:53.933745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb875-acc0-4ea2-9788-7dd4358c6816 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.934095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb875-acc0-4ea2-9788-7dd4358c6816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.934374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccb875-acc0-4ea2-9788-7dd4358c6816 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.945065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccb875-acc0-4ea2-9788-7dd4358c6816 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:53.946958 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccb875-acc0-4ea2-9788-7dd4358c6816 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:53.963728 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-2fccb875-acc0-4ea2-9788-7dd4358c6816 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:13:53.965024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 537/1085] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:53.966640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a5a9-0d69-4f6a-9d0c-43593128c659 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.966933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a5a9-0d69-4f6a-9d0c-43593128c659 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.967201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629a5a9-0d69-4f6a-9d0c-43593128c659 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.968965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 549/1086] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:13:53.970840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccb875-acc0-4ea2-9788-7dd4358c6816 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:53.974134 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885ab25-7cb3-4a19-8f99-a67a4fb2980d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.974417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885ab25-7cb3-4a19-8f99-a67a4fb2980d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.974688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885ab25-7cb3-4a19-8f99-a67a4fb2980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.981600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccb875-acc0-4ea2-9788-7dd4358c6816 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:53.987127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4195567-499d-4ea2-b28c-932373c7c31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:53.987758 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195567-499d-4ea2-b28c-932373c7c31b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:53.988026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195567-499d-4ea2-b28c-932373c7c31b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:53.988304 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4195567-499d-4ea2-b28c-932373c7c31b admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:53.989014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4195567-499d-4ea2-b28c-932373c7c31b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:53.989349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4195567-499d-4ea2-b28c-932373c7c31b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:53.990931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4195567-499d-4ea2-b28c-932373c7c31b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:53.994196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e885ab25-7cb3-4a19-8f99-a67a4fb2980d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:53.995451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e885ab25-7cb3-4a19-8f99-a67a4fb2980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:54.002842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 538/1087] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:54.004379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 550/1088] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:54.008575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4195567-499d-4ea2-b28c-932373c7c31b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:54.017851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4195567-499d-4ea2-b28c-932373c7c31b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:54.022568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a281cc-cb6f-45f1-bb1b-58c6ad588235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:54.023317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a281cc-cb6f-45f1-bb1b-58c6ad588235 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:54.023592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a281cc-cb6f-45f1-bb1b-58c6ad588235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:54.023863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a281cc-cb6f-45f1-bb1b-58c6ad588235 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:54.027378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885ab25-7cb3-4a19-8f99-a67a4fb2980d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:54.031110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a281cc-cb6f-45f1-bb1b-58c6ad588235 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:54.033024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a281cc-cb6f-45f1-bb1b-58c6ad588235 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:54.036409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885ab25-7cb3-4a19-8f99-a67a4fb2980d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:54.040893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fde96-6506-475c-8f60-a8231e4a7f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:54.041724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fde96-6506-475c-8f60-a8231e4a7f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:54.041999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fde96-6506-475c-8f60-a8231e4a7f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:54.042389 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fde96-6506-475c-8f60-a8231e4a7f01 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:54.046700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-14a281cc-cb6f-45f1-bb1b-58c6ad588235 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:13:54.047886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 539/1089] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:13:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:54.053442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a281cc-cb6f-45f1-bb1b-58c6ad588235 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:54.056702 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fde96-6506-475c-8f60-a8231e4a7f01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:54.063216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a281cc-cb6f-45f1-bb1b-58c6ad588235 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:54.063513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-305fde96-6506-475c-8f60-a8231e4a7f01 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:13:54.064868 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 551/1090] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:13:54.068247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a256bb-dbcf-43e8-91c5-9e35637e7d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:54.068852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a256bb-dbcf-43e8-91c5-9e35637e7d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:54.069168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a256bb-dbcf-43e8-91c5-9e35637e7d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:54.069416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a256bb-dbcf-43e8-91c5-9e35637e7d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:54.070197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a256bb-dbcf-43e8-91c5-9e35637e7d60 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:54.070370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fde96-6506-475c-8f60-a8231e4a7f01 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:54.070497 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a256bb-dbcf-43e8-91c5-9e35637e7d60 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:54.072287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a256bb-dbcf-43e8-91c5-9e35637e7d60 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:54.081146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fde96-6506-475c-8f60-a8231e4a7f01 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:54.083847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 540/1091] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:13:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:54.086109 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53775d13-1cbb-4ae8-a050-6f7396811461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:54.086734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53775d13-1cbb-4ae8-a050-6f7396811461 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:54.087006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53775d13-1cbb-4ae8-a050-6f7396811461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:54.087273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53775d13-1cbb-4ae8-a050-6f7396811461 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:54.088021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53775d13-1cbb-4ae8-a050-6f7396811461 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:54.088320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53775d13-1cbb-4ae8-a050-6f7396811461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:54.089745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a256bb-dbcf-43e8-91c5-9e35637e7d60 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:54.089990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53775d13-1cbb-4ae8-a050-6f7396811461 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:54.098574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 552/1092] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:54.099162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a256bb-dbcf-43e8-91c5-9e35637e7d60 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:54.104009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ece5e-17e0-4fd2-a37f-0c69ceb7968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:54.104314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53775d13-1cbb-4ae8-a050-6f7396811461 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:54.104648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ece5e-17e0-4fd2-a37f-0c69ceb7968b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:54.104970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ece5e-17e0-4fd2-a37f-0c69ceb7968b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:54.105256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ece5e-17e0-4fd2-a37f-0c69ceb7968b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:54.106104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ece5e-17e0-4fd2-a37f-0c69ceb7968b admin admin] RBAC: Adding query filter params (role.id=6c1451150c314b4b9938ad823b9a6512, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=43dd173265f24c69af4b13b61722eb51) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:54.106406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ece5e-17e0-4fd2-a37f-0c69ceb7968b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:54.108223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ece5e-17e0-4fd2-a37f-0c69ceb7968b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:54.113474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53775d13-1cbb-4ae8-a050-6f7396811461 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:54.125276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 541/1093] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:54 2022] GET /identity/v3/role_assignments?user.id=43dd173265f24c69af4b13b61722eb51&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=6c1451150c314b4b9938ad823b9a6512 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:54.125522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9689b7e-0e36-4cf0-b09f-f64354302fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:54.125522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9689b7e-0e36-4cf0-b09f-f64354302fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:54.125522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9689b7e-0e36-4cf0-b09f-f64354302fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:54.125522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9689b7e-0e36-4cf0-b09f-f64354302fc4 admin admin] PATH_INFO: `/v3/users/12c9b14fb57a4010b503c846b5e84a9f` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:54.125863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9689b7e-0e36-4cf0-b09f-f64354302fc4 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c9b14fb57a4010b503c846b5e84a9f)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:54.125863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9689b7e-0e36-4cf0-b09f-f64354302fc4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:54.125863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 553/1094] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:13:54 2022] GET /identity/v3/users/12c9b14fb57a4010b503c846b5e84a9f => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:54.130538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ece5e-17e0-4fd2-a37f-0c69ceb7968b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:54.140868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ece5e-17e0-4fd2-a37f-0c69ceb7968b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:54.146306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aa410-ce41-4c5a-88bb-501a5bae6548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:54.147318 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa410-ce41-4c5a-88bb-501a5bae6548 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:54.147658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa410-ce41-4c5a-88bb-501a5bae6548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:54.147929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa410-ce41-4c5a-88bb-501a5bae6548 admin admin] PATH_INFO: `/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:54.149268 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066aa410-ce41-4c5a-88bb-501a5bae6548 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b89e1e18d944de5b3e3db1a7f4b715d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:54.151370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066aa410-ce41-4c5a-88bb-501a5bae6548 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:54.153315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 542/1095] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:13:54 2022] GET /identity/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:54.159673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9689b7e-0e36-4cf0-b09f-f64354302fc4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:54.170304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9689b7e-0e36-4cf0-b09f-f64354302fc4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:54.175077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adcc11-774c-4a35-8bcd-85e7fd9c4617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:54.176001 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adcc11-774c-4a35-8bcd-85e7fd9c4617 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:54.176279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adcc11-774c-4a35-8bcd-85e7fd9c4617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:54.176561 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adcc11-774c-4a35-8bcd-85e7fd9c4617 admin admin] PATH_INFO: `/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d/users/12c9b14fb57a4010b503c846b5e84a9f/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:54.178725 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adcc11-774c-4a35-8bcd-85e7fd9c4617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b89e1e18d944de5b3e3db1a7f4b715d, user_id=12c9b14fb57a4010b503c846b5e84a9f, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:54.181448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adcc11-774c-4a35-8bcd-85e7fd9c4617 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:54.197107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 554/1096] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:13:54 2022] PUT /identity/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d/users/12c9b14fb57a4010b503c846b5e84a9f/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:13:56.401076 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c36b5-e711-4ba1-be4b-3b56d6e9adc9 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:56.402007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c36b5-e711-4ba1-be4b-3b56d6e9adc9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:56.402007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c36b5-e711-4ba1-be4b-3b56d6e9adc9 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:56.404792 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 543/1097] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:56.410317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d43541-5f11-4c5f-a967-4da09a40fcea None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:56.410754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d43541-5f11-4c5f-a967-4da09a40fcea None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:56.410844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d43541-5f11-4c5f-a967-4da09a40fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:56.430544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-62d43541-5f11-4c5f-a967-4da09a40fcea None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:56.431737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-62d43541-5f11-4c5f-a967-4da09a40fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:56.496074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 555/1098] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:56.520727 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c36b5-e711-4ba1-be4b-3b56d6e9adc9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:56.541970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c36b5-e711-4ba1-be4b-3b56d6e9adc9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:56.548147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478017-9e5b-43ac-9e97-6cb83edc4614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:56.548922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478017-9e5b-43ac-9e97-6cb83edc4614 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:56.549200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478017-9e5b-43ac-9e97-6cb83edc4614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:56.549509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478017-9e5b-43ac-9e97-6cb83edc4614 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:56.561774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6478017-9e5b-43ac-9e97-6cb83edc4614 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:13:56.568514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c6478017-9e5b-43ac-9e97-6cb83edc4614 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:13:56.569697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 544/1099] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:13:56.575729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d43541-5f11-4c5f-a967-4da09a40fcea None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:56.584726 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d43541-5f11-4c5f-a967-4da09a40fcea None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:56.589796 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb22548-cb0f-49cf-a926-77be4d437b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:56.590443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb22548-cb0f-49cf-a926-77be4d437b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:56.590715 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb22548-cb0f-49cf-a926-77be4d437b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:56.590986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb22548-cb0f-49cf-a926-77be4d437b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:56.591750 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb22548-cb0f-49cf-a926-77be4d437b55 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:56.592052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb22548-cb0f-49cf-a926-77be4d437b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:56.593691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb22548-cb0f-49cf-a926-77be4d437b55 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:56.602399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 556/1100] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:13:56.608168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478017-9e5b-43ac-9e97-6cb83edc4614 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:56.619073 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478017-9e5b-43ac-9e97-6cb83edc4614 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:56.625087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d617b3-1f33-4107-a938-fa85e83f7bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:56.625959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d617b3-1f33-4107-a938-fa85e83f7bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:56.626210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d617b3-1f33-4107-a938-fa85e83f7bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:56.626476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d617b3-1f33-4107-a938-fa85e83f7bd7 admin admin] PATH_INFO: `/v3/users/12c9b14fb57a4010b503c846b5e84a9f` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:56.627760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d617b3-1f33-4107-a938-fa85e83f7bd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=12c9b14fb57a4010b503c846b5e84a9f)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:56.629938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d617b3-1f33-4107-a938-fa85e83f7bd7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:56.631538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 545/1101] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:13:56 2022] GET /identity/v3/users/12c9b14fb57a4010b503c846b5e84a9f => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:56.637412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb22548-cb0f-49cf-a926-77be4d437b55 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:56.647221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb22548-cb0f-49cf-a926-77be4d437b55 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:56.652299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155a53-6964-42da-9960-2101e01e8d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:56.652921 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155a53-6964-42da-9960-2101e01e8d57 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:56.653193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155a53-6964-42da-9960-2101e01e8d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:56.653510 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40155a53-6964-42da-9960-2101e01e8d57 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:56.661311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40155a53-6964-42da-9960-2101e01e8d57 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:56.663049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40155a53-6964-42da-9960-2101e01e8d57 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:56.671920 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 557/1102] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:13:56 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:13:56.677482 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d617b3-1f33-4107-a938-fa85e83f7bd7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:56.688300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d617b3-1f33-4107-a938-fa85e83f7bd7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:56.693980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bb817-173a-4de7-aad3-5c98c1b92eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:56.694793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb817-173a-4de7-aad3-5c98c1b92eba admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:56.695072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb817-173a-4de7-aad3-5c98c1b92eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:56.695341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bb817-173a-4de7-aad3-5c98c1b92eba admin admin] PATH_INFO: `/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:56.696648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bb817-173a-4de7-aad3-5c98c1b92eba admin admin] RBAC: Authorizing `identity:get_project(project_id=0b89e1e18d944de5b3e3db1a7f4b715d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:56.698684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bb817-173a-4de7-aad3-5c98c1b92eba admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:56.700296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 546/1103] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:13:56 2022] GET /identity/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:56.708748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155a53-6964-42da-9960-2101e01e8d57 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:56.718176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40155a53-6964-42da-9960-2101e01e8d57 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:56.724408 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720f00e-0673-46cb-ad1b-6e2b7e264e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:56.725013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720f00e-0673-46cb-ad1b-6e2b7e264e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:56.725313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720f00e-0673-46cb-ad1b-6e2b7e264e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:56.725581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720f00e-0673-46cb-ad1b-6e2b7e264e1e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:56.726411 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720f00e-0673-46cb-ad1b-6e2b7e264e1e admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=0b89e1e18d944de5b3e3db1a7f4b715d, user.id=12c9b14fb57a4010b503c846b5e84a9f) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:13:56.726713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720f00e-0673-46cb-ad1b-6e2b7e264e1e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:56.728487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720f00e-0673-46cb-ad1b-6e2b7e264e1e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:56.734552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 558/1104] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:13:56 2022] GET /identity/v3/role_assignments?user.id=12c9b14fb57a4010b503c846b5e84a9f&scope.project.id=0b89e1e18d944de5b3e3db1a7f4b715d&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:58.923497 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d90da-67cc-4b9a-bb90-fa9ccec1bfc1 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:58.924416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d90da-67cc-4b9a-bb90-fa9ccec1bfc1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:58.924416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d90da-67cc-4b9a-bb90-fa9ccec1bfc1 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:58.927278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 547/1105] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:13:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:13:58.932840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362f16-85d2-4be3-a688-825d423d109f None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:58.933299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362f16-85d2-4be3-a688-825d423d109f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:58.933401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362f16-85d2-4be3-a688-825d423d109f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:58.951341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-3a362f16-85d2-4be3-a688-825d423d109f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:13:58.952509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3a362f16-85d2-4be3-a688-825d423d109f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:13:58.960664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 559/1106] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:13:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:13:58.985852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d90da-67cc-4b9a-bb90-fa9ccec1bfc1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:59.000535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d90da-67cc-4b9a-bb90-fa9ccec1bfc1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:59.006242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3e2d2-3626-4019-aeb5-f9f97fc18e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:59.007008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3e2d2-3626-4019-aeb5-f9f97fc18e19 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:59.007281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3e2d2-3626-4019-aeb5-f9f97fc18e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:59.007553 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3e2d2-3626-4019-aeb5-f9f97fc18e19 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:59.008954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3e2d2-3626-4019-aeb5-f9f97fc18e19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:59.010678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3e2d2-3626-4019-aeb5-f9f97fc18e19 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:59.012352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 548/1107] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:13:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:13:59.018013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362f16-85d2-4be3-a688-825d423d109f None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:13:59.028709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362f16-85d2-4be3-a688-825d423d109f None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:13:59.033701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b93b3a-cf31-4b55-a3a4-7f21acab890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:13:59.034377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b93b3a-cf31-4b55-a3a4-7f21acab890e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:13:59.034670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b93b3a-cf31-4b55-a3a4-7f21acab890e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:13:59.034936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b93b3a-cf31-4b55-a3a4-7f21acab890e admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:13:59.035658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b93b3a-cf31-4b55-a3a4-7f21acab890e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:13:59.037585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b93b3a-cf31-4b55-a3a4-7f21acab890e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:13:59.060159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 560/1108] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:13:59 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:14:01.271095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1b400-4b46-43c2-b659-781f4595d939 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:01.271950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1b400-4b46-43c2-b659-781f4595d939 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:01.271950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1b400-4b46-43c2-b659-781f4595d939 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:01.274836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 549/1109] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:01.282878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43811ae7-7e02-4ddf-a2c1-822b5c2567d7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:01.283340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43811ae7-7e02-4ddf-a2c1-822b5c2567d7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:01.283437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43811ae7-7e02-4ddf-a2c1-822b5c2567d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:01.302667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-43811ae7-7e02-4ddf-a2c1-822b5c2567d7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:01.303846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-43811ae7-7e02-4ddf-a2c1-822b5c2567d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:01.312204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 561/1110] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:01.335776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1b400-4b46-43c2-b659-781f4595d939 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:01.350126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1b400-4b46-43c2-b659-781f4595d939 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:01.355348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4258c1e-6f85-4d16-81bb-94daaa5692f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:01.356171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258c1e-6f85-4d16-81bb-94daaa5692f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:01.356448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258c1e-6f85-4d16-81bb-94daaa5692f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:01.356719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258c1e-6f85-4d16-81bb-94daaa5692f2 admin admin] PATH_INFO: `/v3/roles/7cc6510c2843471b8db1852425803574` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:01.358308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4258c1e-6f85-4d16-81bb-94daaa5692f2 admin admin] RBAC: Authorizing `identity:get_role(role_id=7cc6510c2843471b8db1852425803574)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:01.359333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-b4258c1e-6f85-4d16-81bb-94daaa5692f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:14:01.359333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:14:01.359333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:14:01.360202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4258c1e-6f85-4d16-81bb-94daaa5692f2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:01.361546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 550/1111] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:01 2022] GET /identity/v3/roles/7cc6510c2843471b8db1852425803574 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:01.366997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43811ae7-7e02-4ddf-a2c1-822b5c2567d7 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:01.376229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43811ae7-7e02-4ddf-a2c1-822b5c2567d7 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:01.382343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa46c4-95b5-4be4-af7d-26c93d756990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:01.383195 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa46c4-95b5-4be4-af7d-26c93d756990 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:01.383470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa46c4-95b5-4be4-af7d-26c93d756990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:01.383734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa46c4-95b5-4be4-af7d-26c93d756990 admin admin] PATH_INFO: `/v3/users/8ca3bdc2256e475a86115de14d166267` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:01.398202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa46c4-95b5-4be4-af7d-26c93d756990 admin admin] RBAC: Authorizing `identity:get_user(user_id=8ca3bdc2256e475a86115de14d166267)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:01.400317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa46c4-95b5-4be4-af7d-26c93d756990 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:01.402028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 562/1112] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:01 2022] GET /identity/v3/users/8ca3bdc2256e475a86115de14d166267 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:01.408049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4258c1e-6f85-4d16-81bb-94daaa5692f2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:01.423773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4258c1e-6f85-4d16-81bb-94daaa5692f2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:01.433113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1445bf7-a55b-4774-9852-a6b316a58adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:01.433756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445bf7-a55b-4774-9852-a6b316a58adf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:01.434026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445bf7-a55b-4774-9852-a6b316a58adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:01.434304 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1445bf7-a55b-4774-9852-a6b316a58adf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:01.442690 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1445bf7-a55b-4774-9852-a6b316a58adf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:01.444421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1445bf7-a55b-4774-9852-a6b316a58adf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:01.453568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 551/1113] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:14:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:14:01.459129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa46c4-95b5-4be4-af7d-26c93d756990 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:01.469345 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa46c4-95b5-4be4-af7d-26c93d756990 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:01.475759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd27a0-a563-4bf5-ac5c-7b0c0c67e878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:01.476577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd27a0-a563-4bf5-ac5c-7b0c0c67e878 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:01.476848 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd27a0-a563-4bf5-ac5c-7b0c0c67e878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:01.477114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd27a0-a563-4bf5-ac5c-7b0c0c67e878 admin admin] PATH_INFO: `/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:01.478485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd27a0-a563-4bf5-ac5c-7b0c0c67e878 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b89e1e18d944de5b3e3db1a7f4b715d)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:01.480451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd27a0-a563-4bf5-ac5c-7b0c0c67e878 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:01.482097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 563/1114] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:14:01 2022] GET /identity/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:01.487801 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1445bf7-a55b-4774-9852-a6b316a58adf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:01.496814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1445bf7-a55b-4774-9852-a6b316a58adf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:01.503322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc58beb-0904-4ec7-bd3a-e205e78a1057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:01.503932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc58beb-0904-4ec7-bd3a-e205e78a1057 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:01.504204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc58beb-0904-4ec7-bd3a-e205e78a1057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:01.504474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc58beb-0904-4ec7-bd3a-e205e78a1057 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:01.505345 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc58beb-0904-4ec7-bd3a-e205e78a1057 admin admin] RBAC: Adding query filter params (role.id=7cc6510c2843471b8db1852425803574, scope.project.id=0b89e1e18d944de5b3e3db1a7f4b715d, user.id=8ca3bdc2256e475a86115de14d166267) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:01.505650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc58beb-0904-4ec7-bd3a-e205e78a1057 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:01.507437 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc58beb-0904-4ec7-bd3a-e205e78a1057 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:01.513694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 552/1115] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:14:01 2022] GET /identity/v3/role_assignments?user.id=8ca3bdc2256e475a86115de14d166267&scope.project.id=0b89e1e18d944de5b3e3db1a7f4b715d&role.id=7cc6510c2843471b8db1852425803574 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:03.659873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbdf8a-8cf8-4ce0-88d1-515dd4065b61 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:03.660423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbdf8a-8cf8-4ce0-88d1-515dd4065b61 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:03.660423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbdf8a-8cf8-4ce0-88d1-515dd4065b61 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:03.662243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 564/1116] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:03.667789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22454-dcef-48ad-98ad-79106119d8ec None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:03.668227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22454-dcef-48ad-98ad-79106119d8ec None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:03.668331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa22454-dcef-48ad-98ad-79106119d8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:03.688022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9fa22454-dcef-48ad-98ad-79106119d8ec None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:03.689194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9fa22454-dcef-48ad-98ad-79106119d8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:03.697480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 553/1117] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:14:03.720484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbdf8a-8cf8-4ce0-88d1-515dd4065b61 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:03.733700 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbdf8a-8cf8-4ce0-88d1-515dd4065b61 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:03.738611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd3f0f-f185-4ad5-ab4c-1a36aec857df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:03.739444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3f0f-f185-4ad5-ab4c-1a36aec857df admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:03.739724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3f0f-f185-4ad5-ab4c-1a36aec857df admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:03.739997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3f0f-f185-4ad5-ab4c-1a36aec857df admin admin] PATH_INFO: `/v3/roles/7cc6510c2843471b8db1852425803574` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:03.741512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd3f0f-f185-4ad5-ab4c-1a36aec857df admin admin] RBAC: Authorizing `identity:get_role(role_id=7cc6510c2843471b8db1852425803574)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:03.742546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-a6fd3f0f-f185-4ad5-ab4c-1a36aec857df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:14:03.742546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:14:03.742546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:14:03.743408 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd3f0f-f185-4ad5-ab4c-1a36aec857df admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:03.744717 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 565/1118] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:03 2022] GET /identity/v3/roles/7cc6510c2843471b8db1852425803574 => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:03.753075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa22454-dcef-48ad-98ad-79106119d8ec None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:03.762845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa22454-dcef-48ad-98ad-79106119d8ec None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:03.769292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b851767-1716-4850-9f62-be935c3c554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:03.770142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b851767-1716-4850-9f62-be935c3c554e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:03.770417 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b851767-1716-4850-9f62-be935c3c554e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:03.770683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b851767-1716-4850-9f62-be935c3c554e admin admin] PATH_INFO: `/v3/users/8ca3bdc2256e475a86115de14d166267` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:03.772108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b851767-1716-4850-9f62-be935c3c554e admin admin] RBAC: Authorizing `identity:get_user(user_id=8ca3bdc2256e475a86115de14d166267)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:03.774252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b851767-1716-4850-9f62-be935c3c554e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:03.775814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 554/1119] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:03 2022] GET /identity/v3/users/8ca3bdc2256e475a86115de14d166267 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:03.782015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd3f0f-f185-4ad5-ab4c-1a36aec857df admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:03.795684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd3f0f-f185-4ad5-ab4c-1a36aec857df admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:03.800936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7495c-5f95-4559-8c7b-a38315ff77d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:03.801770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7495c-5f95-4559-8c7b-a38315ff77d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:03.802042 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7495c-5f95-4559-8c7b-a38315ff77d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:03.802313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7495c-5f95-4559-8c7b-a38315ff77d0 admin admin] PATH_INFO: `/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:03.803600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7495c-5f95-4559-8c7b-a38315ff77d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b89e1e18d944de5b3e3db1a7f4b715d)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:03.805627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7495c-5f95-4559-8c7b-a38315ff77d0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:03.807224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 566/1120] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:14:03 2022] GET /identity/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:03.812704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b851767-1716-4850-9f62-be935c3c554e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:03.822702 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b851767-1716-4850-9f62-be935c3c554e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:03.828785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e3d5c-3465-4e9a-88c1-73014bc234ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:03.829667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e3d5c-3465-4e9a-88c1-73014bc234ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:03.829961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e3d5c-3465-4e9a-88c1-73014bc234ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:03.830230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e3d5c-3465-4e9a-88c1-73014bc234ca admin admin] PATH_INFO: `/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d/users/8ca3bdc2256e475a86115de14d166267/roles/7cc6510c2843471b8db1852425803574` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:03.832868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e3d5c-3465-4e9a-88c1-73014bc234ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b89e1e18d944de5b3e3db1a7f4b715d, user_id=8ca3bdc2256e475a86115de14d166267, role_id=7cc6510c2843471b8db1852425803574)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:03.835500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e3d5c-3465-4e9a-88c1-73014bc234ca admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:03.851861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 555/1121] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:14:03 2022] PUT /identity/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d/users/8ca3bdc2256e475a86115de14d166267/roles/7cc6510c2843471b8db1852425803574 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:14:06.063729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94903a-66fc-41b9-b473-f6e1614cb9af None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:06.064683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94903a-66fc-41b9-b473-f6e1614cb9af None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:06.064683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94903a-66fc-41b9-b473-f6e1614cb9af None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:06.067576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 567/1122] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:06.076261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b65ac-cf3f-4ccb-b4a0-1d3d12d69ec9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:06.076683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b65ac-cf3f-4ccb-b4a0-1d3d12d69ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:06.076793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b65ac-cf3f-4ccb-b4a0-1d3d12d69ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:06.108875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-073b65ac-cf3f-4ccb-b4a0-1d3d12d69ec9 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:06.110127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-073b65ac-cf3f-4ccb-b4a0-1d3d12d69ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:06.179420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 556/1123] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:06.204650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94903a-66fc-41b9-b473-f6e1614cb9af None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:06.227030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94903a-66fc-41b9-b473-f6e1614cb9af None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:06.234952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900a8e0-109f-4c26-accf-e3c0e089fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:06.235804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900a8e0-109f-4c26-accf-e3c0e089fae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:06.236077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900a8e0-109f-4c26-accf-e3c0e089fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:06.236343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900a8e0-109f-4c26-accf-e3c0e089fae4 admin admin] PATH_INFO: `/v3/roles/7cc6510c2843471b8db1852425803574` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:06.238068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900a8e0-109f-4c26-accf-e3c0e089fae4 admin admin] RBAC: Authorizing `identity:get_role(role_id=7cc6510c2843471b8db1852425803574)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:06.239660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900a8e0-109f-4c26-accf-e3c0e089fae4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:06.240986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 568/1124] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:06 2022] GET /identity/v3/roles/7cc6510c2843471b8db1852425803574 => generated 223 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:06.246748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b65ac-cf3f-4ccb-b4a0-1d3d12d69ec9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:06.256281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b65ac-cf3f-4ccb-b4a0-1d3d12d69ec9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:06.261943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d1c7-afe6-4af2-8d85-dc96eae9c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:06.262859 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d1c7-afe6-4af2-8d85-dc96eae9c511 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:06.263140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d1c7-afe6-4af2-8d85-dc96eae9c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:06.263412 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0d1c7-afe6-4af2-8d85-dc96eae9c511 admin admin] PATH_INFO: `/v3/users/8ca3bdc2256e475a86115de14d166267` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:06.264680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0d1c7-afe6-4af2-8d85-dc96eae9c511 admin admin] RBAC: Authorizing `identity:get_user(user_id=8ca3bdc2256e475a86115de14d166267)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:06.266806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0d1c7-afe6-4af2-8d85-dc96eae9c511 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:06.268457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 557/1125] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:06 2022] GET /identity/v3/users/8ca3bdc2256e475a86115de14d166267 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:06.273916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900a8e0-109f-4c26-accf-e3c0e089fae4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:06.284084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900a8e0-109f-4c26-accf-e3c0e089fae4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:06.290282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f35f44-61a2-46e5-8a54-223e4ba40922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:06.290885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f35f44-61a2-46e5-8a54-223e4ba40922 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:06.291171 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f35f44-61a2-46e5-8a54-223e4ba40922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:06.291429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f35f44-61a2-46e5-8a54-223e4ba40922 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:06.299786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f35f44-61a2-46e5-8a54-223e4ba40922 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:06.301524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f35f44-61a2-46e5-8a54-223e4ba40922 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:06.310401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 569/1126] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:14:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:14:06.316590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d1c7-afe6-4af2-8d85-dc96eae9c511 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:06.326676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0d1c7-afe6-4af2-8d85-dc96eae9c511 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:06.332767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00354627-2847-4b2e-9f25-f0aae70fccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:06.333628 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00354627-2847-4b2e-9f25-f0aae70fccfe admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:06.333905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00354627-2847-4b2e-9f25-f0aae70fccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:06.334172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00354627-2847-4b2e-9f25-f0aae70fccfe admin admin] PATH_INFO: `/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:06.335569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00354627-2847-4b2e-9f25-f0aae70fccfe admin admin] RBAC: Authorizing `identity:get_project(project_id=0b89e1e18d944de5b3e3db1a7f4b715d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:06.337714 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00354627-2847-4b2e-9f25-f0aae70fccfe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:06.339385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 558/1127] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:14:06 2022] GET /identity/v3/projects/0b89e1e18d944de5b3e3db1a7f4b715d => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:14:06.345658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f35f44-61a2-46e5-8a54-223e4ba40922 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:06.355196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f35f44-61a2-46e5-8a54-223e4ba40922 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:06.361396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be659ce-3d04-497a-bf4d-57a13b91e606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:06.362020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be659ce-3d04-497a-bf4d-57a13b91e606 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:06.362292 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be659ce-3d04-497a-bf4d-57a13b91e606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:06.362558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be659ce-3d04-497a-bf4d-57a13b91e606 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:06.363419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be659ce-3d04-497a-bf4d-57a13b91e606 admin admin] RBAC: Adding query filter params (role.id=7cc6510c2843471b8db1852425803574, scope.project.id=0b89e1e18d944de5b3e3db1a7f4b715d, user.id=8ca3bdc2256e475a86115de14d166267) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:06.363717 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be659ce-3d04-497a-bf4d-57a13b91e606 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:06.365611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be659ce-3d04-497a-bf4d-57a13b91e606 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:06.371714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 570/1128] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:14:06 2022] GET /identity/v3/role_assignments?user.id=8ca3bdc2256e475a86115de14d166267&scope.project.id=0b89e1e18d944de5b3e3db1a7f4b715d&role.id=7cc6510c2843471b8db1852425803574 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:08.580672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ceac1-70bd-4be0-bf62-733d6639096e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:08.581571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ceac1-70bd-4be0-bf62-733d6639096e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:08.581571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ceac1-70bd-4be0-bf62-733d6639096e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:08.584503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 559/1129] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:08.590129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05728c26-ac3c-469a-8f8e-27e6999f6244 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:08.590575 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05728c26-ac3c-469a-8f8e-27e6999f6244 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:08.590670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05728c26-ac3c-469a-8f8e-27e6999f6244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:08.610320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-05728c26-ac3c-469a-8f8e-27e6999f6244 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:08.611489 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-05728c26-ac3c-469a-8f8e-27e6999f6244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:08.620176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 571/1130] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:08.644236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ceac1-70bd-4be0-bf62-733d6639096e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:08.659098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ceac1-70bd-4be0-bf62-733d6639096e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:08.665199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1885869-720b-4b82-9bef-613ef5308e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:08.666008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1885869-720b-4b82-9bef-613ef5308e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:08.666287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1885869-720b-4b82-9bef-613ef5308e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:08.666565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1885869-720b-4b82-9bef-613ef5308e97 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:08.667879 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1885869-720b-4b82-9bef-613ef5308e97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:08.669601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1885869-720b-4b82-9bef-613ef5308e97 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:08.671193 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 560/1131] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:14:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:08.677025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05728c26-ac3c-469a-8f8e-27e6999f6244 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:08.686696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05728c26-ac3c-469a-8f8e-27e6999f6244 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:08.691707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46976d47-e2ff-4c0f-8f96-9dc1e5b4a388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:08.692355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976d47-e2ff-4c0f-8f96-9dc1e5b4a388 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:08.692633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976d47-e2ff-4c0f-8f96-9dc1e5b4a388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:08.692917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46976d47-e2ff-4c0f-8f96-9dc1e5b4a388 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:08.693677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46976d47-e2ff-4c0f-8f96-9dc1e5b4a388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:08.695615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46976d47-e2ff-4c0f-8f96-9dc1e5b4a388 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:08.725997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 572/1132] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:14:08 2022] POST /identity/v3/projects => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:14:10.955728 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af83c6-5926-4597-98de-97f2dfb5d50d None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:10.956602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af83c6-5926-4597-98de-97f2dfb5d50d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:10.956602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af83c6-5926-4597-98de-97f2dfb5d50d None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:10.959431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 561/1133] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:10.964932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5ed9-6066-464d-9fc3-3309ba5e2f2a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:10.965403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5ed9-6066-464d-9fc3-3309ba5e2f2a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:10.965492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5ed9-6066-464d-9fc3-3309ba5e2f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:10.985070 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-680a5ed9-6066-464d-9fc3-3309ba5e2f2a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:10.986277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-680a5ed9-6066-464d-9fc3-3309ba5e2f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:11.044504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 573/1134] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:11.070212 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af83c6-5926-4597-98de-97f2dfb5d50d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:11.091771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af83c6-5926-4597-98de-97f2dfb5d50d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:11.098329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a6b74-c472-40d1-b999-a8cfc5e8dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:11.099093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a6b74-c472-40d1-b999-a8cfc5e8dd4e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:11.099370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a6b74-c472-40d1-b999-a8cfc5e8dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:11.099635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a6b74-c472-40d1-b999-a8cfc5e8dd4e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:11.100956 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a6b74-c472-40d1-b999-a8cfc5e8dd4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:11.102665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a6b74-c472-40d1-b999-a8cfc5e8dd4e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:11.104211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 562/1135] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:14:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:11.109920 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a5ed9-6066-464d-9fc3-3309ba5e2f2a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:11.120118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a5ed9-6066-464d-9fc3-3309ba5e2f2a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:11.125453 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6215ad0-1cf8-45f4-8087-c9e5def06b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:11.126111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215ad0-1cf8-45f4-8087-c9e5def06b6e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:11.126386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215ad0-1cf8-45f4-8087-c9e5def06b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:11.126660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215ad0-1cf8-45f4-8087-c9e5def06b6e admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:11.127374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6215ad0-1cf8-45f4-8087-c9e5def06b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:11.129324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6215ad0-1cf8-45f4-8087-c9e5def06b6e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:11.150674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 574/1136] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:14:11 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:14:13.347969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385cf3-e0e9-4793-b17a-e3ba699e3a56 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:13.348529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385cf3-e0e9-4793-b17a-e3ba699e3a56 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:13.348529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385cf3-e0e9-4793-b17a-e3ba699e3a56 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:13.350292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 563/1137] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:13.356713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f439e-c41f-4f17-a46e-c38f04731eeb None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:13.357426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f439e-c41f-4f17-a46e-c38f04731eeb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:13.357632 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f439e-c41f-4f17-a46e-c38f04731eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:13.381401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-037f439e-c41f-4f17-a46e-c38f04731eeb None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:13.382636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-037f439e-c41f-4f17-a46e-c38f04731eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:13.391171 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 575/1138] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:13.414526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf385cf3-e0e9-4793-b17a-e3ba699e3a56 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:13.427407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf385cf3-e0e9-4793-b17a-e3ba699e3a56 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:13.431731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce35d73-16ea-456b-b56f-a50ec4c3f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:13.432480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce35d73-16ea-456b-b56f-a50ec4c3f2cf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:13.432748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce35d73-16ea-456b-b56f-a50ec4c3f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:13.433010 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce35d73-16ea-456b-b56f-a50ec4c3f2cf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:13.443470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce35d73-16ea-456b-b56f-a50ec4c3f2cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:14:13.450113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-3ce35d73-16ea-456b-b56f-a50ec4c3f2cf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:14:13.451236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 564/1139] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:14:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:14:13.457511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f439e-c41f-4f17-a46e-c38f04731eeb None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:13.469958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f439e-c41f-4f17-a46e-c38f04731eeb None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:13.475920 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfb769-7399-4d04-9d10-9cdf3cb89f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:13.476571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfb769-7399-4d04-9d10-9cdf3cb89f21 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:13.476841 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfb769-7399-4d04-9d10-9cdf3cb89f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:13.477108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfb769-7399-4d04-9d10-9cdf3cb89f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:13.477902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfb769-7399-4d04-9d10-9cdf3cb89f21 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:13.478202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfb769-7399-4d04-9d10-9cdf3cb89f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:13.479824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfb769-7399-4d04-9d10-9cdf3cb89f21 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:13.488444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 576/1140] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:13.493694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce35d73-16ea-456b-b56f-a50ec4c3f2cf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:13.503808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce35d73-16ea-456b-b56f-a50ec4c3f2cf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:13.508752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407bf89-be77-4ae7-805e-6ab5dff0d7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:13.509588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407bf89-be77-4ae7-805e-6ab5dff0d7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:13.509858 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407bf89-be77-4ae7-805e-6ab5dff0d7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:13.510123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407bf89-be77-4ae7-805e-6ab5dff0d7c9 admin admin] PATH_INFO: `/v3/users/600f194bca434d6eaa4415c64d0e5aa3` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:13.523113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407bf89-be77-4ae7-805e-6ab5dff0d7c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=600f194bca434d6eaa4415c64d0e5aa3)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:13.525198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407bf89-be77-4ae7-805e-6ab5dff0d7c9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:13.526794 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 565/1141] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:13 2022] GET /identity/v3/users/600f194bca434d6eaa4415c64d0e5aa3 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:13.532674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfb769-7399-4d04-9d10-9cdf3cb89f21 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:13.546776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfb769-7399-4d04-9d10-9cdf3cb89f21 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:13.552177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6fdb7-c620-4001-84b6-03f94cff8a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:13.552816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6fdb7-c620-4001-84b6-03f94cff8a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:13.553095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6fdb7-c620-4001-84b6-03f94cff8a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:13.553415 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6fdb7-c620-4001-84b6-03f94cff8a50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:13.561781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6fdb7-c620-4001-84b6-03f94cff8a50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:13.563544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6fdb7-c620-4001-84b6-03f94cff8a50 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:13.572657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 577/1142] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:14:13 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:14:13.580391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407bf89-be77-4ae7-805e-6ab5dff0d7c9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:13.595931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407bf89-be77-4ae7-805e-6ab5dff0d7c9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:13.605558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a841d-2aeb-443d-b468-c3a7847fe060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:13.606705 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a841d-2aeb-443d-b468-c3a7847fe060 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:13.607079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a841d-2aeb-443d-b468-c3a7847fe060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:13.607435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a841d-2aeb-443d-b468-c3a7847fe060 admin admin] PATH_INFO: `/v3/projects/7e1bf96ea54747ec83149438de3424f6` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:13.609123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a841d-2aeb-443d-b468-c3a7847fe060 admin admin] RBAC: Authorizing `identity:get_project(project_id=7e1bf96ea54747ec83149438de3424f6)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:13.611174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a841d-2aeb-443d-b468-c3a7847fe060 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:13.612826 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 566/1143] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:14:13 2022] GET /identity/v3/projects/7e1bf96ea54747ec83149438de3424f6 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:13.619272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6fdb7-c620-4001-84b6-03f94cff8a50 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:13.631500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6fdb7-c620-4001-84b6-03f94cff8a50 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:13.637184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf0c86-74a9-462e-9dd7-1b4c3190310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:13.637845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0c86-74a9-462e-9dd7-1b4c3190310b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:13.638117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0c86-74a9-462e-9dd7-1b4c3190310b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:13.638386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf0c86-74a9-462e-9dd7-1b4c3190310b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:13.639344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf0c86-74a9-462e-9dd7-1b4c3190310b admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=7e1bf96ea54747ec83149438de3424f6, user.id=600f194bca434d6eaa4415c64d0e5aa3) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:13.639651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf0c86-74a9-462e-9dd7-1b4c3190310b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:13.641516 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdf0c86-74a9-462e-9dd7-1b4c3190310b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:13.646883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 578/1144] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:14:13 2022] GET /identity/v3/role_assignments?user.id=600f194bca434d6eaa4415c64d0e5aa3&scope.project.id=7e1bf96ea54747ec83149438de3424f6&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:15.785062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341d9f-cefb-4eb7-acea-91c0a12f836c None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:15.785876 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341d9f-cefb-4eb7-acea-91c0a12f836c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:15.785876 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341d9f-cefb-4eb7-acea-91c0a12f836c None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:15.788662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 567/1145] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:15.796765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ee37-56c9-4728-b97b-5254cd91ca1e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:15.797159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ee37-56c9-4728-b97b-5254cd91ca1e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:15.797333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848ee37-56c9-4728-b97b-5254cd91ca1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:15.816997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-7848ee37-56c9-4728-b97b-5254cd91ca1e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:15.818189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7848ee37-56c9-4728-b97b-5254cd91ca1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:15.827102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 579/1146] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:15.850289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3341d9f-cefb-4eb7-acea-91c0a12f836c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:15.864495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3341d9f-cefb-4eb7-acea-91c0a12f836c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:15.870145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e9154-5fde-4b5b-a466-709deb41ed1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:15.870904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e9154-5fde-4b5b-a466-709deb41ed1e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:15.871185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e9154-5fde-4b5b-a466-709deb41ed1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:15.871451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e9154-5fde-4b5b-a466-709deb41ed1e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:15.882527 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e9154-5fde-4b5b-a466-709deb41ed1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:14:15.889216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-153e9154-5fde-4b5b-a466-709deb41ed1e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:14:15.890404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 568/1147] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:14:15.896726 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848ee37-56c9-4728-b97b-5254cd91ca1e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:15.911669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848ee37-56c9-4728-b97b-5254cd91ca1e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:15.920919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf5ee-7fde-4836-b27f-dc740670126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:15.921603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf5ee-7fde-4836-b27f-dc740670126e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:15.921876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf5ee-7fde-4836-b27f-dc740670126e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:15.922144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cf5ee-7fde-4836-b27f-dc740670126e admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:15.922902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cf5ee-7fde-4836-b27f-dc740670126e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:15.923199 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cf5ee-7fde-4836-b27f-dc740670126e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:15.924792 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cf5ee-7fde-4836-b27f-dc740670126e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:15.933446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 580/1148] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:15.939095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e9154-5fde-4b5b-a466-709deb41ed1e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:15.949782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e9154-5fde-4b5b-a466-709deb41ed1e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:15.955544 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d93c83-8cbc-4d7f-ba23-890da9e9edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:15.956358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d93c83-8cbc-4d7f-ba23-890da9e9edb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:15.956626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d93c83-8cbc-4d7f-ba23-890da9e9edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:15.956887 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d93c83-8cbc-4d7f-ba23-890da9e9edb0 admin admin] PATH_INFO: `/v3/users/600f194bca434d6eaa4415c64d0e5aa3` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:15.958336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d93c83-8cbc-4d7f-ba23-890da9e9edb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=600f194bca434d6eaa4415c64d0e5aa3)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:15.960418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d93c83-8cbc-4d7f-ba23-890da9e9edb0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:15.962001 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 569/1149] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:15 2022] GET /identity/v3/users/600f194bca434d6eaa4415c64d0e5aa3 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:15.967249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf5ee-7fde-4836-b27f-dc740670126e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:15.977144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cf5ee-7fde-4836-b27f-dc740670126e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:15.982574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d2ae2-1234-4ef2-a16c-f21b9a7395c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:15.983475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d2ae2-1234-4ef2-a16c-f21b9a7395c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:15.983751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d2ae2-1234-4ef2-a16c-f21b9a7395c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:15.984016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d2ae2-1234-4ef2-a16c-f21b9a7395c5 admin admin] PATH_INFO: `/v3/projects/7e1bf96ea54747ec83149438de3424f6` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:15.985417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d2ae2-1234-4ef2-a16c-f21b9a7395c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=7e1bf96ea54747ec83149438de3424f6)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:15.987529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d2ae2-1234-4ef2-a16c-f21b9a7395c5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:15.989141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 581/1150] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:14:15 2022] GET /identity/v3/projects/7e1bf96ea54747ec83149438de3424f6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:14:15.994630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d93c83-8cbc-4d7f-ba23-890da9e9edb0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:16.005216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d93c83-8cbc-4d7f-ba23-890da9e9edb0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:16.011395 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc909133-b02f-4ac2-9d75-2d7a64d08a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:16.012221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909133-b02f-4ac2-9d75-2d7a64d08a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:16.012492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909133-b02f-4ac2-9d75-2d7a64d08a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:16.012764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc909133-b02f-4ac2-9d75-2d7a64d08a9f admin admin] PATH_INFO: `/v3/projects/7e1bf96ea54747ec83149438de3424f6/users/600f194bca434d6eaa4415c64d0e5aa3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:16.015175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc909133-b02f-4ac2-9d75-2d7a64d08a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1bf96ea54747ec83149438de3424f6, user_id=600f194bca434d6eaa4415c64d0e5aa3, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:16.017955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc909133-b02f-4ac2-9d75-2d7a64d08a9f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:16.033551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 570/1151] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:14:15 2022] PUT /identity/v3/projects/7e1bf96ea54747ec83149438de3424f6/users/600f194bca434d6eaa4415c64d0e5aa3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:14:18.166837 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f80da-5626-4be8-ba22-a4b645bd8234 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:18.167649 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f80da-5626-4be8-ba22-a4b645bd8234 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:18.167649 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f80da-5626-4be8-ba22-a4b645bd8234 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:18.169173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 582/1152] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:18.174829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56702d8b-f624-4145-8455-532f84c53712 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:18.175271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56702d8b-f624-4145-8455-532f84c53712 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:18.175368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56702d8b-f624-4145-8455-532f84c53712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:18.195716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-56702d8b-f624-4145-8455-532f84c53712 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:18.197533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-56702d8b-f624-4145-8455-532f84c53712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:18.256792 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 571/1153] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:18.283115 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f80da-5626-4be8-ba22-a4b645bd8234 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:18.300323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f80da-5626-4be8-ba22-a4b645bd8234 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:18.308416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0e22-7453-42a8-9b6d-8d148b43df03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:18.309593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0e22-7453-42a8-9b6d-8d148b43df03 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:18.309947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0e22-7453-42a8-9b6d-8d148b43df03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:18.310297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0e22-7453-42a8-9b6d-8d148b43df03 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:18.327858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea0e22-7453-42a8-9b6d-8d148b43df03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:14:18.334533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-07ea0e22-7453-42a8-9b6d-8d148b43df03 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:14:18.336000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 583/1154] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:14:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:14:18.345801 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56702d8b-f624-4145-8455-532f84c53712 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:18.356024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56702d8b-f624-4145-8455-532f84c53712 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:18.362499 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaec9e8-5eca-4199-bf9a-08217b2c152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:18.363159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaec9e8-5eca-4199-bf9a-08217b2c152e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:18.363446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaec9e8-5eca-4199-bf9a-08217b2c152e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:18.363712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaec9e8-5eca-4199-bf9a-08217b2c152e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:18.364464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaec9e8-5eca-4199-bf9a-08217b2c152e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:18.364765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaec9e8-5eca-4199-bf9a-08217b2c152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:18.366378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaec9e8-5eca-4199-bf9a-08217b2c152e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:18.375558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 572/1155] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:14:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:18.381570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0e22-7453-42a8-9b6d-8d148b43df03 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:18.395844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0e22-7453-42a8-9b6d-8d148b43df03 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:18.402314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef071d-8ecd-4ca4-84ad-623fae83ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:18.403143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef071d-8ecd-4ca4-84ad-623fae83ecc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:18.403414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef071d-8ecd-4ca4-84ad-623fae83ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:18.403677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef071d-8ecd-4ca4-84ad-623fae83ecc7 admin admin] PATH_INFO: `/v3/users/600f194bca434d6eaa4415c64d0e5aa3` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:18.405175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef071d-8ecd-4ca4-84ad-623fae83ecc7 admin admin] RBAC: Authorizing `identity:get_user(user_id=600f194bca434d6eaa4415c64d0e5aa3)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:18.407289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef071d-8ecd-4ca4-84ad-623fae83ecc7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:18.408852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 584/1156] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:18 2022] GET /identity/v3/users/600f194bca434d6eaa4415c64d0e5aa3 => generated 286 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:14:18.414114 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaec9e8-5eca-4199-bf9a-08217b2c152e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:18.423626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaec9e8-5eca-4199-bf9a-08217b2c152e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:18.429340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683ed5-d5f3-42bf-acd9-3e6585c7575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:18.429961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683ed5-d5f3-42bf-acd9-3e6585c7575a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:18.430241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683ed5-d5f3-42bf-acd9-3e6585c7575a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:18.430507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c683ed5-d5f3-42bf-acd9-3e6585c7575a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:18.438868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c683ed5-d5f3-42bf-acd9-3e6585c7575a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:18.440584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c683ed5-d5f3-42bf-acd9-3e6585c7575a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:18.449649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 573/1157] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:14:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:14:18.455589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef071d-8ecd-4ca4-84ad-623fae83ecc7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:18.468943 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef071d-8ecd-4ca4-84ad-623fae83ecc7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:18.474997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969851fd-d8c2-4bb2-b705-0069f0bfddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:18.475797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969851fd-d8c2-4bb2-b705-0069f0bfddb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:18.476073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969851fd-d8c2-4bb2-b705-0069f0bfddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:18.476343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969851fd-d8c2-4bb2-b705-0069f0bfddb8 admin admin] PATH_INFO: `/v3/projects/7e1bf96ea54747ec83149438de3424f6` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:18.477591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969851fd-d8c2-4bb2-b705-0069f0bfddb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=7e1bf96ea54747ec83149438de3424f6)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:18.479569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969851fd-d8c2-4bb2-b705-0069f0bfddb8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:18.481170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 585/1158] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:14:18 2022] GET /identity/v3/projects/7e1bf96ea54747ec83149438de3424f6 => generated 311 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:18.492264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683ed5-d5f3-42bf-acd9-3e6585c7575a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:18.495771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c683ed5-d5f3-42bf-acd9-3e6585c7575a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:18.500757 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864a60a-c283-4bb5-8b68-156b90ff9510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:18.501402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864a60a-c283-4bb5-8b68-156b90ff9510 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:18.501679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864a60a-c283-4bb5-8b68-156b90ff9510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:18.501952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864a60a-c283-4bb5-8b68-156b90ff9510 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:18.502776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864a60a-c283-4bb5-8b68-156b90ff9510 admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=7e1bf96ea54747ec83149438de3424f6, user.id=600f194bca434d6eaa4415c64d0e5aa3) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:18.503082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864a60a-c283-4bb5-8b68-156b90ff9510 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:18.504863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864a60a-c283-4bb5-8b68-156b90ff9510 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:18.511467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 574/1159] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:14:18 2022] GET /identity/v3/role_assignments?user.id=600f194bca434d6eaa4415c64d0e5aa3&scope.project.id=7e1bf96ea54747ec83149438de3424f6&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:20.701126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed910c-52a5-4129-9474-c7a4a41e4d73 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:20.702059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed910c-52a5-4129-9474-c7a4a41e4d73 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:20.702059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed910c-52a5-4129-9474-c7a4a41e4d73 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:20.704929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 586/1160] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:20.711278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edb96a-9060-4aa5-bb03-fe437e5d1825 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:20.712035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edb96a-9060-4aa5-bb03-fe437e5d1825 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:20.712181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edb96a-9060-4aa5-bb03-fe437e5d1825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:20.734449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-72edb96a-9060-4aa5-bb03-fe437e5d1825 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:20.735620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-72edb96a-9060-4aa5-bb03-fe437e5d1825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:20.745221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 575/1161] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:20.768597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed910c-52a5-4129-9474-c7a4a41e4d73 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:20.786584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed910c-52a5-4129-9474-c7a4a41e4d73 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:20.792323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68f7df-fe4b-4050-9a9a-ce8d3735ff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:20.792982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68f7df-fe4b-4050-9a9a-ce8d3735ff70 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:20.793260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68f7df-fe4b-4050-9a9a-ce8d3735ff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:20.793563 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68f7df-fe4b-4050-9a9a-ce8d3735ff70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:20.801855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68f7df-fe4b-4050-9a9a-ce8d3735ff70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:20.803579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68f7df-fe4b-4050-9a9a-ce8d3735ff70 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:20.812521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 587/1162] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:14:20 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:14:20.818233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edb96a-9060-4aa5-bb03-fe437e5d1825 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:20.827945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edb96a-9060-4aa5-bb03-fe437e5d1825 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:20.834085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69186e6-dccd-402b-9c7a-6f5d77bb8a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:20.834856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69186e6-dccd-402b-9c7a-6f5d77bb8a48 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:20.835127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69186e6-dccd-402b-9c7a-6f5d77bb8a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:20.835387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69186e6-dccd-402b-9c7a-6f5d77bb8a48 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:20.843539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69186e6-dccd-402b-9c7a-6f5d77bb8a48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:20.845368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69186e6-dccd-402b-9c7a-6f5d77bb8a48 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:20.859665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-f69186e6-dccd-402b-9c7a-6f5d77bb8a48 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 28 01:14:20.860774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 576/1163] 10.222.0.16 () {56 vars in 1138 bytes} [Fri Jan 28 01:14:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:14:20.866646 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68f7df-fe4b-4050-9a9a-ce8d3735ff70 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:20.875522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68f7df-fe4b-4050-9a9a-ce8d3735ff70 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:20.881466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5825ec-abbf-4ca5-beea-0a2160a748cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:20.882045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5825ec-abbf-4ca5-beea-0a2160a748cc admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:20.882321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5825ec-abbf-4ca5-beea-0a2160a748cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:20.882597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5825ec-abbf-4ca5-beea-0a2160a748cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:20.883318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5825ec-abbf-4ca5-beea-0a2160a748cc admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:20.883617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5825ec-abbf-4ca5-beea-0a2160a748cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:20.885166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5825ec-abbf-4ca5-beea-0a2160a748cc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:20.892547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 588/1164] 10.222.0.16 () {56 vars in 1136 bytes} [Fri Jan 28 01:14:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:23.040900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76fc5-3105-4312-8379-fff141b947bf None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:23.041484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76fc5-3105-4312-8379-fff141b947bf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:23.041484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f76fc5-3105-4312-8379-fff141b947bf None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:23.043213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 577/1165] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:23.049672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea56ed-6e93-445d-9445-5d5dcbe09a89 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:23.050398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea56ed-6e93-445d-9445-5d5dcbe09a89 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:23.050678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea56ed-6e93-445d-9445-5d5dcbe09a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:23.074657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ddea56ed-6e93-445d-9445-5d5dcbe09a89 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:23.075922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ddea56ed-6e93-445d-9445-5d5dcbe09a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:23.086070 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 589/1166] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:23.110729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f76fc5-3105-4312-8379-fff141b947bf None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:23.130679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f76fc5-3105-4312-8379-fff141b947bf None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:23.137072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163dea2-59e0-433b-8644-42e45cca02f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:23.137736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163dea2-59e0-433b-8644-42e45cca02f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:23.138015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163dea2-59e0-433b-8644-42e45cca02f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:23.138282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163dea2-59e0-433b-8644-42e45cca02f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:23.139031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163dea2-59e0-433b-8644-42e45cca02f4 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:23.140044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-a163dea2-59e0-433b-8644-42e45cca02f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:14:23.140044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:14:23.140044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:14:23.140913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163dea2-59e0-433b-8644-42e45cca02f4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:23.161460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 578/1167] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Jan 28 01:14:23 2022] POST /identity/v3/domains => generated 267 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:14:25.364634 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730423bc-0c79-4d50-ac33-2a20c9213253 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:25.365620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730423bc-0c79-4d50-ac33-2a20c9213253 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:25.365620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730423bc-0c79-4d50-ac33-2a20c9213253 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:25.368402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 590/1168] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:25.374082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e74d-fdae-493b-b973-735affd3fcef None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:25.374527 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e74d-fdae-493b-b973-735affd3fcef None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:25.374625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e74d-fdae-493b-b973-735affd3fcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:25.394049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c133e74d-fdae-493b-b973-735affd3fcef None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:25.395199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c133e74d-fdae-493b-b973-735affd3fcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:25.453461 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 579/1169] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:25.478537 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730423bc-0c79-4d50-ac33-2a20c9213253 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:25.495153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730423bc-0c79-4d50-ac33-2a20c9213253 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:25.501082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca19c5-6b6f-472d-8df0-f6aaa380d574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:25.501944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca19c5-6b6f-472d-8df0-f6aaa380d574 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:25.502217 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca19c5-6b6f-472d-8df0-f6aaa380d574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:25.502479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca19c5-6b6f-472d-8df0-f6aaa380d574 admin admin] PATH_INFO: `/v3/domains/a8bb75657adb4c8ea30d35f2420759f0` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:25.514525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca19c5-6b6f-472d-8df0-f6aaa380d574 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a8bb75657adb4c8ea30d35f2420759f0)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:25.516488 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca19c5-6b6f-472d-8df0-f6aaa380d574 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:25.518088 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 591/1170] 10.222.0.16 () {56 vars in 1204 bytes} [Fri Jan 28 01:14:25 2022] GET /identity/v3/domains/a8bb75657adb4c8ea30d35f2420759f0 => generated 267 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:25.526786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133e74d-fdae-493b-b973-735affd3fcef None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:25.541180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133e74d-fdae-493b-b973-735affd3fcef None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:25.548945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fed08-5a00-4bbe-a07b-7de68617fc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:25.549664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fed08-5a00-4bbe-a07b-7de68617fc14 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:25.549937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fed08-5a00-4bbe-a07b-7de68617fc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:25.550205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fed08-5a00-4bbe-a07b-7de68617fc14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:25.550920 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fed08-5a00-4bbe-a07b-7de68617fc14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:25.552806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fed08-5a00-4bbe-a07b-7de68617fc14 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:25.582664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 580/1171] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:14:25 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:14:27.786898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c43e-68e6-4636-aad1-786334c5cc02 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:27.787762 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c43e-68e6-4636-aad1-786334c5cc02 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:27.787762 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c43e-68e6-4636-aad1-786334c5cc02 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:27.790778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 592/1172] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:27.799159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f1b60-d5f8-41e9-90ef-b458f466289f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:27.799597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f1b60-d5f8-41e9-90ef-b458f466289f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:27.799732 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f1b60-d5f8-41e9-90ef-b458f466289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:27.828848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8a4f1b60-d5f8-41e9-90ef-b458f466289f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:27.830053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8a4f1b60-d5f8-41e9-90ef-b458f466289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:27.891495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 581/1173] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:27.917334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9c43e-68e6-4636-aad1-786334c5cc02 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:27.932451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9c43e-68e6-4636-aad1-786334c5cc02 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:27.938361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62368e-7fd4-4457-a21c-4c5a5f0ca1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:27.939715 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62368e-7fd4-4457-a21c-4c5a5f0ca1ec admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:27.940141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62368e-7fd4-4457-a21c-4c5a5f0ca1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:27.940567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62368e-7fd4-4457-a21c-4c5a5f0ca1ec admin admin] PATH_INFO: `/v3/domains/a8bb75657adb4c8ea30d35f2420759f0` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:27.942687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62368e-7fd4-4457-a21c-4c5a5f0ca1ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=a8bb75657adb4c8ea30d35f2420759f0)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:27.945859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62368e-7fd4-4457-a21c-4c5a5f0ca1ec admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:27.948360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 593/1174] 10.222.0.16 () {56 vars in 1204 bytes} [Fri Jan 28 01:14:27 2022] GET /identity/v3/domains/a8bb75657adb4c8ea30d35f2420759f0 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:27.954209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f1b60-d5f8-41e9-90ef-b458f466289f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:27.968093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f1b60-d5f8-41e9-90ef-b458f466289f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:27.977798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817708-de11-4ba5-8ca1-b9ef773f205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:27.978786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817708-de11-4ba5-8ca1-b9ef773f205d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:27.979197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817708-de11-4ba5-8ca1-b9ef773f205d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:27.979584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817708-de11-4ba5-8ca1-b9ef773f205d admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:27.980702 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817708-de11-4ba5-8ca1-b9ef773f205d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:27.983452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817708-de11-4ba5-8ca1-b9ef773f205d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:28.008192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 582/1175] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:14:27 2022] POST /identity/v3/users => generated 311 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:14:30.190674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33219394-8bc6-4f4e-8174-4543b0b4969e None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:30.191574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33219394-8bc6-4f4e-8174-4543b0b4969e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:30.191574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33219394-8bc6-4f4e-8174-4543b0b4969e None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:30.194491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 594/1176] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:30.200044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9013e1-4b3f-4554-833c-a5bab9dd2cfc None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:30.200505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9013e1-4b3f-4554-833c-a5bab9dd2cfc None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:30.200598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9013e1-4b3f-4554-833c-a5bab9dd2cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:30.220280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8e9013e1-4b3f-4554-833c-a5bab9dd2cfc None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:30.221841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8e9013e1-4b3f-4554-833c-a5bab9dd2cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:30.230400 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 583/1177] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:14:30.254496 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33219394-8bc6-4f4e-8174-4543b0b4969e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:30.273442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33219394-8bc6-4f4e-8174-4543b0b4969e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:30.279810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f92ec-6f2a-4f5b-879a-2224281f6df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:30.280731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f92ec-6f2a-4f5b-879a-2224281f6df7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:30.281187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f92ec-6f2a-4f5b-879a-2224281f6df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:30.281494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f92ec-6f2a-4f5b-879a-2224281f6df7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:30.294181 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f92ec-6f2a-4f5b-879a-2224281f6df7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:14:30.300983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-f08f92ec-6f2a-4f5b-879a-2224281f6df7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:14:30.302160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 595/1178] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:14:30.310831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9013e1-4b3f-4554-833c-a5bab9dd2cfc None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:30.320662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9013e1-4b3f-4554-833c-a5bab9dd2cfc None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:30.326720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6caaf8-f160-48a9-8ad1-da4f53f2b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:30.327363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6caaf8-f160-48a9-8ad1-da4f53f2b4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:30.327637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6caaf8-f160-48a9-8ad1-da4f53f2b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:30.327903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6caaf8-f160-48a9-8ad1-da4f53f2b4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:30.328660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6caaf8-f160-48a9-8ad1-da4f53f2b4d9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:30.328961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6caaf8-f160-48a9-8ad1-da4f53f2b4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:30.330573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6caaf8-f160-48a9-8ad1-da4f53f2b4d9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:30.339065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 584/1179] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:30.344603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f92ec-6f2a-4f5b-879a-2224281f6df7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:30.355466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f92ec-6f2a-4f5b-879a-2224281f6df7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:30.361923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cd261-24e4-43ad-b79d-647a83bde8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:30.362761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd261-24e4-43ad-b79d-647a83bde8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:30.363038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd261-24e4-43ad-b79d-647a83bde8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:30.363306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd261-24e4-43ad-b79d-647a83bde8e3 admin admin] PATH_INFO: `/v3/users/4e9f795cfb234a73a360051ac2bce37e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:30.379151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cd261-24e4-43ad-b79d-647a83bde8e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=4e9f795cfb234a73a360051ac2bce37e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:30.381290 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cd261-24e4-43ad-b79d-647a83bde8e3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:30.382909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 596/1180] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:30 2022] GET /identity/v3/users/4e9f795cfb234a73a360051ac2bce37e => generated 311 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:30.389009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6caaf8-f160-48a9-8ad1-da4f53f2b4d9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:30.399817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6caaf8-f160-48a9-8ad1-da4f53f2b4d9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:30.406331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e875b98-c4c8-40ea-a4b8-089038edc76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:30.406948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875b98-c4c8-40ea-a4b8-089038edc76c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:30.407221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875b98-c4c8-40ea-a4b8-089038edc76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:30.407485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875b98-c4c8-40ea-a4b8-089038edc76c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:30.415694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e875b98-c4c8-40ea-a4b8-089038edc76c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:30.417450 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e875b98-c4c8-40ea-a4b8-089038edc76c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:30.426406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 585/1181] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:14:30 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:14:30.431842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cd261-24e4-43ad-b79d-647a83bde8e3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:30.441932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cd261-24e4-43ad-b79d-647a83bde8e3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:30.447680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea82b06-7cee-45ea-82f4-ec8d7632f939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:30.448483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea82b06-7cee-45ea-82f4-ec8d7632f939 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:30.448777 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea82b06-7cee-45ea-82f4-ec8d7632f939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:30.449041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea82b06-7cee-45ea-82f4-ec8d7632f939 admin admin] PATH_INFO: `/v3/projects/ce0c38c06468402aae4e811998cafc90` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:30.450396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea82b06-7cee-45ea-82f4-ec8d7632f939 admin admin] RBAC: Authorizing `identity:get_project(project_id=ce0c38c06468402aae4e811998cafc90)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:30.452433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea82b06-7cee-45ea-82f4-ec8d7632f939 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:30.454081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 597/1182] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:14:30 2022] GET /identity/v3/projects/ce0c38c06468402aae4e811998cafc90 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:30.459670 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e875b98-c4c8-40ea-a4b8-089038edc76c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:30.468633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e875b98-c4c8-40ea-a4b8-089038edc76c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:30.475199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aa728-e4f2-4af5-8876-57603d54b864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:30.475804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aa728-e4f2-4af5-8876-57603d54b864 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:30.476083 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aa728-e4f2-4af5-8876-57603d54b864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:30.476349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aa728-e4f2-4af5-8876-57603d54b864 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:30.477172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aa728-e4f2-4af5-8876-57603d54b864 admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=ce0c38c06468402aae4e811998cafc90, user.id=4e9f795cfb234a73a360051ac2bce37e) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:30.477514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aa728-e4f2-4af5-8876-57603d54b864 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:30.479307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aa728-e4f2-4af5-8876-57603d54b864 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:30.484988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 586/1183] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:14:30 2022] GET /identity/v3/role_assignments?user.id=4e9f795cfb234a73a360051ac2bce37e&scope.project.id=ce0c38c06468402aae4e811998cafc90&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:32.610241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452978-aaed-4945-8467-ef19e2b67437 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:32.610827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452978-aaed-4945-8467-ef19e2b67437 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:32.610827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452978-aaed-4945-8467-ef19e2b67437 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:32.613141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 598/1184] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:32.621980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1efad9-d393-4411-a267-c4b005fda7e8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:32.622404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1efad9-d393-4411-a267-c4b005fda7e8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:32.622533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1efad9-d393-4411-a267-c4b005fda7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:32.642804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ca1efad9-d393-4411-a267-c4b005fda7e8 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:32.643980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ca1efad9-d393-4411-a267-c4b005fda7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:32.652522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 587/1185] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:32.675379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34452978-aaed-4945-8467-ef19e2b67437 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:32.690379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34452978-aaed-4945-8467-ef19e2b67437 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:32.696166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d3fb-a8b7-40d3-a0ed-ae7c6f65503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:32.696945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d3fb-a8b7-40d3-a0ed-ae7c6f65503f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:32.697245 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d3fb-a8b7-40d3-a0ed-ae7c6f65503f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:32.697530 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d3fb-a8b7-40d3-a0ed-ae7c6f65503f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:32.709315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02d3fb-a8b7-40d3-a0ed-ae7c6f65503f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:14:32.716021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-8c02d3fb-a8b7-40d3-a0ed-ae7c6f65503f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:14:32.717136 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 599/1186] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:14:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:14:32.723972 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1efad9-d393-4411-a267-c4b005fda7e8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:32.737715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1efad9-d393-4411-a267-c4b005fda7e8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:32.745531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c7d31-4846-48f1-86d8-b4565e232ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:32.746328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c7d31-4846-48f1-86d8-b4565e232ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:32.746617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c7d31-4846-48f1-86d8-b4565e232ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:32.746856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c7d31-4846-48f1-86d8-b4565e232ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:32.748047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c7d31-4846-48f1-86d8-b4565e232ad1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:32.748447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c7d31-4846-48f1-86d8-b4565e232ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:32.750480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c7d31-4846-48f1-86d8-b4565e232ad1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:32.758731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 588/1187] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:14:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:14:32.764457 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d3fb-a8b7-40d3-a0ed-ae7c6f65503f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:32.775669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d3fb-a8b7-40d3-a0ed-ae7c6f65503f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:32.781597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df1aab-0ae9-4f38-a6d7-55e7b071e715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:32.782420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1aab-0ae9-4f38-a6d7-55e7b071e715 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:32.782698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1aab-0ae9-4f38-a6d7-55e7b071e715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:32.782963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1aab-0ae9-4f38-a6d7-55e7b071e715 admin admin] PATH_INFO: `/v3/users/4e9f795cfb234a73a360051ac2bce37e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:32.784360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df1aab-0ae9-4f38-a6d7-55e7b071e715 admin admin] RBAC: Authorizing `identity:get_user(user_id=4e9f795cfb234a73a360051ac2bce37e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:32.786514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df1aab-0ae9-4f38-a6d7-55e7b071e715 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:32.788071 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 600/1188] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:32 2022] GET /identity/v3/users/4e9f795cfb234a73a360051ac2bce37e => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:32.793442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c7d31-4846-48f1-86d8-b4565e232ad1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:32.802878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c7d31-4846-48f1-86d8-b4565e232ad1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:32.809635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7577740-695c-4b19-b973-4438bc970b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:32.810475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7577740-695c-4b19-b973-4438bc970b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:32.810748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7577740-695c-4b19-b973-4438bc970b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:32.811018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7577740-695c-4b19-b973-4438bc970b78 admin admin] PATH_INFO: `/v3/projects/ce0c38c06468402aae4e811998cafc90` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:32.812426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7577740-695c-4b19-b973-4438bc970b78 admin admin] RBAC: Authorizing `identity:get_project(project_id=ce0c38c06468402aae4e811998cafc90)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:32.814478 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7577740-695c-4b19-b973-4438bc970b78 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:32.816133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 589/1189] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:14:32 2022] GET /identity/v3/projects/ce0c38c06468402aae4e811998cafc90 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:14:32.821736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df1aab-0ae9-4f38-a6d7-55e7b071e715 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:32.832038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df1aab-0ae9-4f38-a6d7-55e7b071e715 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:32.837061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26d0c6-07b0-463e-8c3b-8f34ccc0addf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:32.837965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d0c6-07b0-463e-8c3b-8f34ccc0addf admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:32.838234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d0c6-07b0-463e-8c3b-8f34ccc0addf admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:32.838502 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d0c6-07b0-463e-8c3b-8f34ccc0addf admin admin] PATH_INFO: `/v3/projects/ce0c38c06468402aae4e811998cafc90/users/4e9f795cfb234a73a360051ac2bce37e/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:32.840455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26d0c6-07b0-463e-8c3b-8f34ccc0addf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0c38c06468402aae4e811998cafc90, user_id=4e9f795cfb234a73a360051ac2bce37e, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:32.843154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26d0c6-07b0-463e-8c3b-8f34ccc0addf admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:32.859870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 601/1190] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:14:32 2022] PUT /identity/v3/projects/ce0c38c06468402aae4e811998cafc90/users/4e9f795cfb234a73a360051ac2bce37e/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:14:35.020555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94ee72-ca4d-422f-b713-316d2dfc45c0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:35.021672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94ee72-ca4d-422f-b713-316d2dfc45c0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:35.021672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94ee72-ca4d-422f-b713-316d2dfc45c0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:35.024490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 590/1191] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:14:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:14:35.030971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b555b4-fadd-4af3-8e29-fb12363a4e9c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:35.031422 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b555b4-fadd-4af3-8e29-fb12363a4e9c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:35.031512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b555b4-fadd-4af3-8e29-fb12363a4e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:35.059995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-50b555b4-fadd-4af3-8e29-fb12363a4e9c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:14:35.061923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-50b555b4-fadd-4af3-8e29-fb12363a4e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:14:35.120751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 602/1192] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:14:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:14:35.144672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94ee72-ca4d-422f-b713-316d2dfc45c0 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:35.159622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94ee72-ca4d-422f-b713-316d2dfc45c0 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:35.165776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e9e54-4e19-4cfb-a51f-46d084302f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:35.166545 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e9e54-4e19-4cfb-a51f-46d084302f64 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:35.166819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e9e54-4e19-4cfb-a51f-46d084302f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:35.167091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e9e54-4e19-4cfb-a51f-46d084302f64 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:35.178283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e9e54-4e19-4cfb-a51f-46d084302f64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:14:35.184857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-737e9e54-4e19-4cfb-a51f-46d084302f64 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:14:35.186016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 591/1193] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:14:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:14:35.192433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b555b4-fadd-4af3-8e29-fb12363a4e9c None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:35.205086 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b555b4-fadd-4af3-8e29-fb12363a4e9c None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:35.211712 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b6d8e-29e4-4494-9251-ba20c868efb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:35.212357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6d8e-29e4-4494-9251-ba20c868efb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:35.212633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6d8e-29e4-4494-9251-ba20c868efb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:35.212897 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6d8e-29e4-4494-9251-ba20c868efb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:35.213695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b6d8e-29e4-4494-9251-ba20c868efb0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:35.213993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b6d8e-29e4-4494-9251-ba20c868efb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:35.215590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b6d8e-29e4-4494-9251-ba20c868efb0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:35.224383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 603/1194] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:14:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:14:35.229944 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e9e54-4e19-4cfb-a51f-46d084302f64 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:35.240260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e9e54-4e19-4cfb-a51f-46d084302f64 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:35.245563 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1d0a9-7a79-40c8-8006-8898bfcf89be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:35.246379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1d0a9-7a79-40c8-8006-8898bfcf89be admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:35.246652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1d0a9-7a79-40c8-8006-8898bfcf89be admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:35.246921 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1d0a9-7a79-40c8-8006-8898bfcf89be admin admin] PATH_INFO: `/v3/users/4e9f795cfb234a73a360051ac2bce37e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:35.248210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1d0a9-7a79-40c8-8006-8898bfcf89be admin admin] RBAC: Authorizing `identity:get_user(user_id=4e9f795cfb234a73a360051ac2bce37e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:35.250428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1d0a9-7a79-40c8-8006-8898bfcf89be admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:35.251966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 592/1195] 10.222.0.16 () {56 vars in 1198 bytes} [Fri Jan 28 01:14:35 2022] GET /identity/v3/users/4e9f795cfb234a73a360051ac2bce37e => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:14:35.257383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b6d8e-29e4-4494-9251-ba20c868efb0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:35.266834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b6d8e-29e4-4494-9251-ba20c868efb0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:35.272428 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64506c-e303-4bb0-8195-32b05147b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:35.272976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64506c-e303-4bb0-8195-32b05147b42a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:35.273255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64506c-e303-4bb0-8195-32b05147b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:35.273546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64506c-e303-4bb0-8195-32b05147b42a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:35.281398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64506c-e303-4bb0-8195-32b05147b42a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:35.283193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64506c-e303-4bb0-8195-32b05147b42a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:35.291630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 604/1196] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:14:35 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:14:35.297638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1d0a9-7a79-40c8-8006-8898bfcf89be admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:35.312793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1d0a9-7a79-40c8-8006-8898bfcf89be admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:35.321213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ecadc-4753-4863-9714-c20447876f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:35.322044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ecadc-4753-4863-9714-c20447876f9f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:35.322351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ecadc-4753-4863-9714-c20447876f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:35.322620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ecadc-4753-4863-9714-c20447876f9f admin admin] PATH_INFO: `/v3/projects/ce0c38c06468402aae4e811998cafc90` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:35.323794 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ecadc-4753-4863-9714-c20447876f9f admin admin] RBAC: Authorizing `identity:get_project(project_id=ce0c38c06468402aae4e811998cafc90)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:35.325853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ecadc-4753-4863-9714-c20447876f9f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:35.327572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 593/1197] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:14:35 2022] GET /identity/v3/projects/ce0c38c06468402aae4e811998cafc90 => generated 361 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:14:35.333080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64506c-e303-4bb0-8195-32b05147b42a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:14:35.341726 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64506c-e303-4bb0-8195-32b05147b42a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:14:35.347390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0da2ae-b452-436d-88f5-3447b4901aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:14:35.348004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da2ae-b452-436d-88f5-3447b4901aee admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:14:35.348277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da2ae-b452-436d-88f5-3447b4901aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:14:35.348545 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da2ae-b452-436d-88f5-3447b4901aee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:14:35.349434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0da2ae-b452-436d-88f5-3447b4901aee admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=ce0c38c06468402aae4e811998cafc90, user.id=4e9f795cfb234a73a360051ac2bce37e) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:14:35.349741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0da2ae-b452-436d-88f5-3447b4901aee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:14:35.351503 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0da2ae-b452-436d-88f5-3447b4901aee admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:14:35.357317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 605/1198] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:14:35 2022] GET /identity/v3/role_assignments?user.id=4e9f795cfb234a73a360051ac2bce37e&scope.project.id=ce0c38c06468402aae4e811998cafc90&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:15:35.320793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1c72-63eb-43c8-8b3e-417e965ce91e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:35.321441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1c72-63eb-43c8-8b3e-417e965ce91e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:35.321441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1c72-63eb-43c8-8b3e-417e965ce91e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:35.323132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 594/1199] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:15:35.329369 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0fae4-2234-4fb2-ac88-e2e324571f30 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:35.329843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0fae4-2234-4fb2-ac88-e2e324571f30 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:35.329929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0fae4-2234-4fb2-ac88-e2e324571f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:35.353153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-01c0fae4-2234-4fb2-ac88-e2e324571f30 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:15:35.354395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-01c0fae4-2234-4fb2-ac88-e2e324571f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:15:35.363948 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 606/1200] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:15:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:15:35.393180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd1c72-63eb-43c8-8b3e-417e965ce91e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:35.411307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd1c72-63eb-43c8-8b3e-417e965ce91e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:35.421466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b884f8-ef5f-41d2-8533-b08b490b5dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:35.422685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b884f8-ef5f-41d2-8533-b08b490b5dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:35.423020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b884f8-ef5f-41d2-8533-b08b490b5dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:35.423347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b884f8-ef5f-41d2-8533-b08b490b5dd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:35.439682 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b884f8-ef5f-41d2-8533-b08b490b5dd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:35.441934 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b884f8-ef5f-41d2-8533-b08b490b5dd4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:35.463218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-30b884f8-ef5f-41d2-8533-b08b490b5dd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:35.464649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 595/1201] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:35.471464 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0fae4-2234-4fb2-ac88-e2e324571f30 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:35.482192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0fae4-2234-4fb2-ac88-e2e324571f30 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:35.487187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c83d3-3a42-4792-a5de-6a8f436e4916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:35.487963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c83d3-3a42-4792-a5de-6a8f436e4916 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:35.488304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c83d3-3a42-4792-a5de-6a8f436e4916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:35.488603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c83d3-3a42-4792-a5de-6a8f436e4916 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:35.489560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c83d3-3a42-4792-a5de-6a8f436e4916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:35.489888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c83d3-3a42-4792-a5de-6a8f436e4916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:35.491942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c83d3-3a42-4792-a5de-6a8f436e4916 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:35.509510 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 607/1202] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:15:35.514740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b884f8-ef5f-41d2-8533-b08b490b5dd4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:35.524784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b884f8-ef5f-41d2-8533-b08b490b5dd4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:35.529899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ca072-3a9e-4aa7-be28-d42fe946540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:35.530652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ca072-3a9e-4aa7-be28-d42fe946540d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:35.530951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ca072-3a9e-4aa7-be28-d42fe946540d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:35.531310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ca072-3a9e-4aa7-be28-d42fe946540d admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:35.532098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ca072-3a9e-4aa7-be28-d42fe946540d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:35.534199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ca072-3a9e-4aa7-be28-d42fe946540d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:35.557201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 596/1203] 10.222.0.16 () {60 vars in 1153 bytes} [Fri Jan 28 01:15:35 2022] POST /identity/v3/users => generated 251 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:15:38.074874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a762a-3d18-4099-bdb6-5d711a9563aa None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.075441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a762a-3d18-4099-bdb6-5d711a9563aa None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.075441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a762a-3d18-4099-bdb6-5d711a9563aa None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.077200 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 608/1204] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:15:38.082981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca0aa-8d0f-4f82-a4e7-a2f37e7cced3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.083522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca0aa-8d0f-4f82-a4e7-a2f37e7cced3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.083522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca0aa-8d0f-4f82-a4e7-a2f37e7cced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.103372 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-999ca0aa-8d0f-4f82-a4e7-a2f37e7cced3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:15:38.104611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-999ca0aa-8d0f-4f82-a4e7-a2f37e7cced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:15:38.114860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 597/1205] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:15:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:15:38.139057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a762a-3d18-4099-bdb6-5d711a9563aa None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.151572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a762a-3d18-4099-bdb6-5d711a9563aa None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.155945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a01753-5db6-408e-8aec-984e7cb6cea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.156714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a01753-5db6-408e-8aec-984e7cb6cea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.156986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a01753-5db6-408e-8aec-984e7cb6cea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.157275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a01753-5db6-408e-8aec-984e7cb6cea3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.168581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a01753-5db6-408e-8aec-984e7cb6cea3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:15:38.175429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-89a01753-5db6-408e-8aec-984e7cb6cea3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:15:38.176796 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 609/1206] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:38.182996 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca0aa-8d0f-4f82-a4e7-a2f37e7cced3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.193272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca0aa-8d0f-4f82-a4e7-a2f37e7cced3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.198908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef5496-19ec-4170-927a-ab449de2d83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.199854 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef5496-19ec-4170-927a-ab449de2d83d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.200344 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef5496-19ec-4170-927a-ab449de2d83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.200566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef5496-19ec-4170-927a-ab449de2d83d admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.201387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef5496-19ec-4170-927a-ab449de2d83d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:38.201688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef5496-19ec-4170-927a-ab449de2d83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.203326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef5496-19ec-4170-927a-ab449de2d83d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.212799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 598/1207] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:38.219193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a01753-5db6-408e-8aec-984e7cb6cea3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.230319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a01753-5db6-408e-8aec-984e7cb6cea3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.235028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896c1a9-03de-4f86-9824-4461e0a83fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.235831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896c1a9-03de-4f86-9824-4461e0a83fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.236104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896c1a9-03de-4f86-9824-4461e0a83fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.236370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896c1a9-03de-4f86-9824-4461e0a83fc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.248799 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896c1a9-03de-4f86-9824-4461e0a83fc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.250703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896c1a9-03de-4f86-9824-4461e0a83fc8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.268402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-8896c1a9-03de-4f86-9824-4461e0a83fc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:38.269644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 610/1208] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:38.276036 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef5496-19ec-4170-927a-ab449de2d83d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.286130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef5496-19ec-4170-927a-ab449de2d83d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.291056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a537e-4478-49b3-9f3c-aeeb30bb3c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.291681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a537e-4478-49b3-9f3c-aeeb30bb3c8c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.293530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a537e-4478-49b3-9f3c-aeeb30bb3c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.293857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a537e-4478-49b3-9f3c-aeeb30bb3c8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.294831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a537e-4478-49b3-9f3c-aeeb30bb3c8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:38.295154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a537e-4478-49b3-9f3c-aeeb30bb3c8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.296785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a537e-4478-49b3-9f3c-aeeb30bb3c8c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.310704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 599/1209] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:15:38.318733 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896c1a9-03de-4f86-9824-4461e0a83fc8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.328785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896c1a9-03de-4f86-9824-4461e0a83fc8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.333720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bf96e-3cad-4814-b833-e4198bc46f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.334517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bf96e-3cad-4814-b833-e4198bc46f35 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.334790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bf96e-3cad-4814-b833-e4198bc46f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.335055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bf96e-3cad-4814-b833-e4198bc46f35 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.342743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737bf96e-3cad-4814-b833-e4198bc46f35 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.344747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737bf96e-3cad-4814-b833-e4198bc46f35 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.361840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-737bf96e-3cad-4814-b833-e4198bc46f35 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:15:38.363230 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 611/1210] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:38.369600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a537e-4478-49b3-9f3c-aeeb30bb3c8c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.380817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a537e-4478-49b3-9f3c-aeeb30bb3c8c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.386202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce33c32-03da-4b58-87e5-51bd6dcd4c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.386962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce33c32-03da-4b58-87e5-51bd6dcd4c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.387328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce33c32-03da-4b58-87e5-51bd6dcd4c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.387672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce33c32-03da-4b58-87e5-51bd6dcd4c50 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.388591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce33c32-03da-4b58-87e5-51bd6dcd4c50 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:38.388961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce33c32-03da-4b58-87e5-51bd6dcd4c50 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.390930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce33c32-03da-4b58-87e5-51bd6dcd4c50 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.410205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 600/1211] 10.222.0.16 () {56 vars in 1164 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:15:38.416295 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bf96e-3cad-4814-b833-e4198bc46f35 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.426931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bf96e-3cad-4814-b833-e4198bc46f35 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.433028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0352-2668-4bf3-86e1-78ec3f67e715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.433857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0352-2668-4bf3-86e1-78ec3f67e715 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.434205 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0352-2668-4bf3-86e1-78ec3f67e715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.434518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0352-2668-4bf3-86e1-78ec3f67e715 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.443952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df0352-2668-4bf3-86e1-78ec3f67e715 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.446269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df0352-2668-4bf3-86e1-78ec3f67e715 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.461623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 612/1212] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:15:38.463471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce33c32-03da-4b58-87e5-51bd6dcd4c50 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.473737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce33c32-03da-4b58-87e5-51bd6dcd4c50 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.478557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f92d6b-73ea-40df-9dd0-7faee002c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.479495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f92d6b-73ea-40df-9dd0-7faee002c029 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.479840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f92d6b-73ea-40df-9dd0-7faee002c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.480234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f92d6b-73ea-40df-9dd0-7faee002c029 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.492025 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f92d6b-73ea-40df-9dd0-7faee002c029 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.494072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f92d6b-73ea-40df-9dd0-7faee002c029 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.513221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-69f92d6b-73ea-40df-9dd0-7faee002c029 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:38.514649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 601/1213] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:38.521204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0352-2668-4bf3-86e1-78ec3f67e715 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.530670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0352-2668-4bf3-86e1-78ec3f67e715 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.535894 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900e06-2c1c-4197-854c-295553eb4ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.536680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900e06-2c1c-4197-854c-295553eb4ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.536971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900e06-2c1c-4197-854c-295553eb4ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.537277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900e06-2c1c-4197-854c-295553eb4ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.538145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63900e06-2c1c-4197-854c-295553eb4ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:38.538533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63900e06-2c1c-4197-854c-295553eb4ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.540293 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63900e06-2c1c-4197-854c-295553eb4ee2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.553098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 613/1214] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:38.559433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f92d6b-73ea-40df-9dd0-7faee002c029 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.570819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f92d6b-73ea-40df-9dd0-7faee002c029 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.576378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70ee1a-0a10-4525-9115-3691d31fca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.577322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70ee1a-0a10-4525-9115-3691d31fca8c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.577783 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70ee1a-0a10-4525-9115-3691d31fca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.578157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70ee1a-0a10-4525-9115-3691d31fca8c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.586633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70ee1a-0a10-4525-9115-3691d31fca8c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.588880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70ee1a-0a10-4525-9115-3691d31fca8c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.606739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-df70ee1a-0a10-4525-9115-3691d31fca8c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:15:38.612803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 602/1215] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:38.614476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900e06-2c1c-4197-854c-295553eb4ee2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.624912 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900e06-2c1c-4197-854c-295553eb4ee2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.631038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368c06e-4ca3-4550-a447-c70c11efb4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.631169 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368c06e-4ca3-4550-a447-c70c11efb4ee admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.631329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368c06e-4ca3-4550-a447-c70c11efb4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.631598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368c06e-4ca3-4550-a447-c70c11efb4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.632414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368c06e-4ca3-4550-a447-c70c11efb4ee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:38.632718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368c06e-4ca3-4550-a447-c70c11efb4ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.634606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368c06e-4ca3-4550-a447-c70c11efb4ee admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.648614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 614/1216] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:15:38.654702 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70ee1a-0a10-4525-9115-3691d31fca8c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:38.666662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70ee1a-0a10-4525-9115-3691d31fca8c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:38.671554 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa18ac6-31ac-41ff-a594-4439a3db706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:38.672190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa18ac6-31ac-41ff-a594-4439a3db706f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:38.672468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa18ac6-31ac-41ff-a594-4439a3db706f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:38.672740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa18ac6-31ac-41ff-a594-4439a3db706f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:38.673614 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa18ac6-31ac-41ff-a594-4439a3db706f admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=aac3e041554a4439bfa91520e52fbd2e) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:38.673921 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa18ac6-31ac-41ff-a594-4439a3db706f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:38.675753 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa18ac6-31ac-41ff-a594-4439a3db706f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:38.681887 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 603/1217] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:15:38 2022] GET /identity/v3/role_assignments?user.id=aac3e041554a4439bfa91520e52fbd2e&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:41.023360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf0fe9-efd7-4f70-bf7c-e7eeea67a6dd None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.023935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf0fe9-efd7-4f70-bf7c-e7eeea67a6dd None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.023935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf0fe9-efd7-4f70-bf7c-e7eeea67a6dd None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.025963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 615/1218] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:15:41.031072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5810-7690-4fc0-81f6-e85c1ca59925 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.031761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5810-7690-4fc0-81f6-e85c1ca59925 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.031761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5810-7690-4fc0-81f6-e85c1ca59925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.048863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e55a5810-7690-4fc0-81f6-e85c1ca59925 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:15:41.050051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e55a5810-7690-4fc0-81f6-e85c1ca59925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:15:41.058128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 604/1219] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:15:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:15:41.080648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf0fe9-efd7-4f70-bf7c-e7eeea67a6dd None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.093486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf0fe9-efd7-4f70-bf7c-e7eeea67a6dd None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.100602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19befd53-1035-4bf2-9138-afc6fc5e979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.101578 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19befd53-1035-4bf2-9138-afc6fc5e979e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.101857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19befd53-1035-4bf2-9138-afc6fc5e979e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.102150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19befd53-1035-4bf2-9138-afc6fc5e979e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.115871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19befd53-1035-4bf2-9138-afc6fc5e979e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:15:41.124881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-19befd53-1035-4bf2-9138-afc6fc5e979e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:15:41.129257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 616/1220] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:41.132778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5810-7690-4fc0-81f6-e85c1ca59925 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.141820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5810-7690-4fc0-81f6-e85c1ca59925 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.146527 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63a10b-0a25-4dd4-b28b-e6552e30bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.147170 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63a10b-0a25-4dd4-b28b-e6552e30bd34 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.147449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63a10b-0a25-4dd4-b28b-e6552e30bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.147719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63a10b-0a25-4dd4-b28b-e6552e30bd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.148491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63a10b-0a25-4dd4-b28b-e6552e30bd34 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:41.148791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63a10b-0a25-4dd4-b28b-e6552e30bd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:41.150478 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63a10b-0a25-4dd4-b28b-e6552e30bd34 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:41.163735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 605/1221] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:41.164721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19befd53-1035-4bf2-9138-afc6fc5e979e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.176790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19befd53-1035-4bf2-9138-afc6fc5e979e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.182584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef7ed5-97d0-4007-a307-67b532ce7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.183392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef7ed5-97d0-4007-a307-67b532ce7c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.183673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef7ed5-97d0-4007-a307-67b532ce7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.183954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef7ed5-97d0-4007-a307-67b532ce7c27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.195397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef7ed5-97d0-4007-a307-67b532ce7c27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:41.197311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef7ed5-97d0-4007-a307-67b532ce7c27 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:41.215221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-7cef7ed5-97d0-4007-a307-67b532ce7c27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:41.222664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63a10b-0a25-4dd4-b28b-e6552e30bd34 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.223108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 617/1222] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:41.232721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63a10b-0a25-4dd4-b28b-e6552e30bd34 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.237807 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ab690-fb3d-4832-b9e0-47a4f6e53b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.238471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ab690-fb3d-4832-b9e0-47a4f6e53b75 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.238747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ab690-fb3d-4832-b9e0-47a4f6e53b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.239016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ab690-fb3d-4832-b9e0-47a4f6e53b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.239772 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ab690-fb3d-4832-b9e0-47a4f6e53b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:41.240074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ab690-fb3d-4832-b9e0-47a4f6e53b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:41.241706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ab690-fb3d-4832-b9e0-47a4f6e53b75 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:41.254023 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 606/1223] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:41.259550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef7ed5-97d0-4007-a307-67b532ce7c27 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.269391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef7ed5-97d0-4007-a307-67b532ce7c27 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.274259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3b48-a1e4-4dc9-9faf-68b91bbb77a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.274980 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3b48-a1e4-4dc9-9faf-68b91bbb77a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.275263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3b48-a1e4-4dc9-9faf-68b91bbb77a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.275562 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3b48-a1e4-4dc9-9faf-68b91bbb77a6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.283246 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3b48-a1e4-4dc9-9faf-68b91bbb77a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:41.285253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3b48-a1e4-4dc9-9faf-68b91bbb77a6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:41.299598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-99fe3b48-a1e4-4dc9-9faf-68b91bbb77a6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:15:41.305856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 618/1224] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:41.306977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ab690-fb3d-4832-b9e0-47a4f6e53b75 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.317485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ab690-fb3d-4832-b9e0-47a4f6e53b75 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.322295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58336aa1-43b5-45d6-8550-d3e7564580f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.322956 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58336aa1-43b5-45d6-8550-d3e7564580f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.323336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58336aa1-43b5-45d6-8550-d3e7564580f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.323540 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58336aa1-43b5-45d6-8550-d3e7564580f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.324352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58336aa1-43b5-45d6-8550-d3e7564580f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:41.324652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58336aa1-43b5-45d6-8550-d3e7564580f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:41.326560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58336aa1-43b5-45d6-8550-d3e7564580f2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:41.346456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 607/1225] 10.222.0.16 () {56 vars in 1164 bytes} [Fri Jan 28 01:15:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:15:41.352176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3b48-a1e4-4dc9-9faf-68b91bbb77a6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.362060 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3b48-a1e4-4dc9-9faf-68b91bbb77a6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.366737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef8d5-a580-4c6b-bca3-ab6391053d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.367517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef8d5-a580-4c6b-bca3-ab6391053d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.367801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef8d5-a580-4c6b-bca3-ab6391053d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.368070 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef8d5-a580-4c6b-bca3-ab6391053d4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.378764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef8d5-a580-4c6b-bca3-ab6391053d4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:41.380711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef8d5-a580-4c6b-bca3-ab6391053d4e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:41.399501 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-049ef8d5-a580-4c6b-bca3-ab6391053d4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:41.400928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 619/1226] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:41.407652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58336aa1-43b5-45d6-8550-d3e7564580f2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.418963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58336aa1-43b5-45d6-8550-d3e7564580f2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.424128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418fc2-ba2b-4182-9fd6-af5b82b28ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.424785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418fc2-ba2b-4182-9fd6-af5b82b28ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.425070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418fc2-ba2b-4182-9fd6-af5b82b28ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.425363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418fc2-ba2b-4182-9fd6-af5b82b28ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.426105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418fc2-ba2b-4182-9fd6-af5b82b28ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:41.426411 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418fc2-ba2b-4182-9fd6-af5b82b28ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:41.428027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418fc2-ba2b-4182-9fd6-af5b82b28ed0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:41.440821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 608/1227] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:41.446795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef8d5-a580-4c6b-bca3-ab6391053d4e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.457527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef8d5-a580-4c6b-bca3-ab6391053d4e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.462608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd80b58-5178-48bf-9b85-d0c2999e62ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.463505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80b58-5178-48bf-9b85-d0c2999e62ec admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.463658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80b58-5178-48bf-9b85-d0c2999e62ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.463937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80b58-5178-48bf-9b85-d0c2999e62ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.473379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd80b58-5178-48bf-9b85-d0c2999e62ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:41.475935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd80b58-5178-48bf-9b85-d0c2999e62ec admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:41.491860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-dcd80b58-5178-48bf-9b85-d0c2999e62ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:15:41.493252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 620/1228] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:41.500201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418fc2-ba2b-4182-9fd6-af5b82b28ed0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.511964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418fc2-ba2b-4182-9fd6-af5b82b28ed0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.516532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14812a1f-0023-46a2-bd57-ae071936743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.517304 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14812a1f-0023-46a2-bd57-ae071936743e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.517662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14812a1f-0023-46a2-bd57-ae071936743e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.517999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14812a1f-0023-46a2-bd57-ae071936743e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.518911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14812a1f-0023-46a2-bd57-ae071936743e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:41.519286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14812a1f-0023-46a2-bd57-ae071936743e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:41.521287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14812a1f-0023-46a2-bd57-ae071936743e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:41.534914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 609/1229] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:15:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:41.541073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd80b58-5178-48bf-9b85-d0c2999e62ec admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:41.551506 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd80b58-5178-48bf-9b85-d0c2999e62ec admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:41.556804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176602c-8b41-4428-ba50-0f3ca0fda326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:41.557874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176602c-8b41-4428-ba50-0f3ca0fda326 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:41.558154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176602c-8b41-4428-ba50-0f3ca0fda326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:41.558428 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176602c-8b41-4428-ba50-0f3ca0fda326 admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/aac3e041554a4439bfa91520e52fbd2e/roles/13ec9c0076334780847c0f750f4af8f4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:41.574011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176602c-8b41-4428-ba50-0f3ca0fda326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=aac3e041554a4439bfa91520e52fbd2e, role_id=13ec9c0076334780847c0f750f4af8f4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:41.576656 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176602c-8b41-4428-ba50-0f3ca0fda326 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:41.590508 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 621/1230] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:15:41 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/aac3e041554a4439bfa91520e52fbd2e/roles/13ec9c0076334780847c0f750f4af8f4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:15:44.147043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6921-390b-4253-a073-90bbd455ae22 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.147697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6921-390b-4253-a073-90bbd455ae22 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.147697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a6921-390b-4253-a073-90bbd455ae22 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.149751 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 610/1231] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:15:44.156507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9931-7198-40e2-b531-ac5c0f7adcff None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.156974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9931-7198-40e2-b531-ac5c0f7adcff None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.157105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9931-7198-40e2-b531-ac5c0f7adcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.176811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-68bb9931-7198-40e2-b531-ac5c0f7adcff None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:15:44.178124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-68bb9931-7198-40e2-b531-ac5c0f7adcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:15:44.240541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 622/1232] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:15:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:15:44.266703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6921-390b-4253-a073-90bbd455ae22 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.280159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a6921-390b-4253-a073-90bbd455ae22 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.285207 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86b9f8-392e-4f3a-bf89-2ee8dbba3402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.286100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86b9f8-392e-4f3a-bf89-2ee8dbba3402 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.286404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86b9f8-392e-4f3a-bf89-2ee8dbba3402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.286744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86b9f8-392e-4f3a-bf89-2ee8dbba3402 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.300020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86b9f8-392e-4f3a-bf89-2ee8dbba3402 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:15:44.306828 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-eb86b9f8-392e-4f3a-bf89-2ee8dbba3402 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 28 01:15:44.308041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 611/1233] 10.222.0.16 () {56 vars in 1123 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:44.314255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb9931-7198-40e2-b531-ac5c0f7adcff None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.323918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb9931-7198-40e2-b531-ac5c0f7adcff None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.329734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c1dae-d3ee-4164-9f1f-bc59c4227fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.330526 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c1dae-d3ee-4164-9f1f-bc59c4227fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.330827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c1dae-d3ee-4164-9f1f-bc59c4227fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.331161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c1dae-d3ee-4164-9f1f-bc59c4227fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.332098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c1dae-d3ee-4164-9f1f-bc59c4227fcd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:44.332358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c1dae-d3ee-4164-9f1f-bc59c4227fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.334256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c1dae-d3ee-4164-9f1f-bc59c4227fcd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.343514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 623/1234] 10.222.0.16 () {56 vars in 1124 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:15:44.349759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86b9f8-392e-4f3a-bf89-2ee8dbba3402 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.359922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86b9f8-392e-4f3a-bf89-2ee8dbba3402 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.365209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e391c-4be7-4532-9ea1-8169c3352fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.366006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e391c-4be7-4532-9ea1-8169c3352fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.366277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e391c-4be7-4532-9ea1-8169c3352fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.366537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e391c-4be7-4532-9ea1-8169c3352fb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.377247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e391c-4be7-4532-9ea1-8169c3352fb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.379113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e391c-4be7-4532-9ea1-8169c3352fb6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.397274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e24e391c-4be7-4532-9ea1-8169c3352fb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:44.398559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 612/1235] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:44.404445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c1dae-d3ee-4164-9f1f-bc59c4227fcd admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.415392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c1dae-d3ee-4164-9f1f-bc59c4227fcd admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.419994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f8b8e-bfcd-48ad-abaf-ace58cc4500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.420648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8b8e-bfcd-48ad-abaf-ace58cc4500d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.420923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8b8e-bfcd-48ad-abaf-ace58cc4500d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.421189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f8b8e-bfcd-48ad-abaf-ace58cc4500d admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.421946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f8b8e-bfcd-48ad-abaf-ace58cc4500d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:44.422245 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f8b8e-bfcd-48ad-abaf-ace58cc4500d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.423828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f8b8e-bfcd-48ad-abaf-ace58cc4500d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.437118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 624/1236] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:44.442821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e391c-4be7-4532-9ea1-8169c3352fb6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.453272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e391c-4be7-4532-9ea1-8169c3352fb6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.458468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fe9d8-65eb-49a5-972f-ae01e5d0239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.459342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe9d8-65eb-49a5-972f-ae01e5d0239b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.459623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe9d8-65eb-49a5-972f-ae01e5d0239b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.459892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fe9d8-65eb-49a5-972f-ae01e5d0239b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.467586 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fe9d8-65eb-49a5-972f-ae01e5d0239b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.469630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fe9d8-65eb-49a5-972f-ae01e5d0239b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.483642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-643fe9d8-65eb-49a5-972f-ae01e5d0239b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:15:44.484812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 613/1237] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:44.490964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f8b8e-bfcd-48ad-abaf-ace58cc4500d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.501145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f8b8e-bfcd-48ad-abaf-ace58cc4500d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.506140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73291729-d5aa-4d86-b9c8-94e642c974d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.506768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73291729-d5aa-4d86-b9c8-94e642c974d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.507044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73291729-d5aa-4d86-b9c8-94e642c974d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.507308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73291729-d5aa-4d86-b9c8-94e642c974d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.508158 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73291729-d5aa-4d86-b9c8-94e642c974d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:44.508458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73291729-d5aa-4d86-b9c8-94e642c974d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.510325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73291729-d5aa-4d86-b9c8-94e642c974d9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.527300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 625/1238] 10.222.0.16 () {56 vars in 1164 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:44.533256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fe9d8-65eb-49a5-972f-ae01e5d0239b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.542904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fe9d8-65eb-49a5-972f-ae01e5d0239b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.547467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4890a-5167-456f-bb77-19d71940df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.548120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4890a-5167-456f-bb77-19d71940df8b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.548376 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4890a-5167-456f-bb77-19d71940df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.548640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4890a-5167-456f-bb77-19d71940df8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.556475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4890a-5167-456f-bb77-19d71940df8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.558279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4890a-5167-456f-bb77-19d71940df8b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.567616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 614/1239] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:15:44.573557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73291729-d5aa-4d86-b9c8-94e642c974d9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.584342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73291729-d5aa-4d86-b9c8-94e642c974d9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.589337 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c91a7b-90d4-47c0-8f58-5c92038cece9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.590131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c91a7b-90d4-47c0-8f58-5c92038cece9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.590397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c91a7b-90d4-47c0-8f58-5c92038cece9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.590658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c91a7b-90d4-47c0-8f58-5c92038cece9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.601366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c91a7b-90d4-47c0-8f58-5c92038cece9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.603201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c91a7b-90d4-47c0-8f58-5c92038cece9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.620982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-52c91a7b-90d4-47c0-8f58-5c92038cece9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:44.622260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 626/1240] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:44.629182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4890a-5167-456f-bb77-19d71940df8b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.638109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4890a-5167-456f-bb77-19d71940df8b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.643056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab640054-c8ca-4705-ace1-0ba6a195db52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.643704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab640054-c8ca-4705-ace1-0ba6a195db52 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.643980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab640054-c8ca-4705-ace1-0ba6a195db52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.644244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab640054-c8ca-4705-ace1-0ba6a195db52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.644965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab640054-c8ca-4705-ace1-0ba6a195db52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:44.645287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab640054-c8ca-4705-ace1-0ba6a195db52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.647149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab640054-c8ca-4705-ace1-0ba6a195db52 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.658735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 615/1241] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:44.664663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c91a7b-90d4-47c0-8f58-5c92038cece9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.675648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c91a7b-90d4-47c0-8f58-5c92038cece9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.680162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50318b3e-8d2e-4d5e-ad79-6de659ea80ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.680945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50318b3e-8d2e-4d5e-ad79-6de659ea80ac admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.681217 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50318b3e-8d2e-4d5e-ad79-6de659ea80ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.681515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50318b3e-8d2e-4d5e-ad79-6de659ea80ac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.689574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50318b3e-8d2e-4d5e-ad79-6de659ea80ac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.691691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50318b3e-8d2e-4d5e-ad79-6de659ea80ac admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.705234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-50318b3e-8d2e-4d5e-ad79-6de659ea80ac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:15:44.706443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 627/1242] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:44.712567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab640054-c8ca-4705-ace1-0ba6a195db52 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.723257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab640054-c8ca-4705-ace1-0ba6a195db52 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.728559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c58d02-ca8f-4344-b150-b3940d495542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.729688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c58d02-ca8f-4344-b150-b3940d495542 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.730072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c58d02-ca8f-4344-b150-b3940d495542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.730348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c58d02-ca8f-4344-b150-b3940d495542 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.731315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c58d02-ca8f-4344-b150-b3940d495542 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:44.731622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c58d02-ca8f-4344-b150-b3940d495542 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.733628 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c58d02-ca8f-4344-b150-b3940d495542 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.747097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 616/1243] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:15:44.753188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50318b3e-8d2e-4d5e-ad79-6de659ea80ac admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:44.763727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50318b3e-8d2e-4d5e-ad79-6de659ea80ac admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:44.768960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb9da7-a9cb-4999-b615-fcb58dbe3059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:44.769701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb9da7-a9cb-4999-b615-fcb58dbe3059 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:44.770061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb9da7-a9cb-4999-b615-fcb58dbe3059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:44.770339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb9da7-a9cb-4999-b615-fcb58dbe3059 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:44.771300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb9da7-a9cb-4999-b615-fcb58dbe3059 admin admin] RBAC: Adding query filter params (role.id=13ec9c0076334780847c0f750f4af8f4, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=aac3e041554a4439bfa91520e52fbd2e) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:44.771608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb9da7-a9cb-4999-b615-fcb58dbe3059 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:44.773549 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb9da7-a9cb-4999-b615-fcb58dbe3059 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:44.780500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 628/1244] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:15:44 2022] GET /identity/v3/role_assignments?user.id=aac3e041554a4439bfa91520e52fbd2e&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=13ec9c0076334780847c0f750f4af8f4 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:47.068636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50227022-fbdb-49d0-938a-e62b7b5bb553 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.069365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50227022-fbdb-49d0-938a-e62b7b5bb553 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.069365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50227022-fbdb-49d0-938a-e62b7b5bb553 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.071519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 617/1245] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:15:47.076797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522ab01-0a9c-416a-8366-27e7bd9a9f2f None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.077317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522ab01-0a9c-416a-8366-27e7bd9a9f2f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.077444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522ab01-0a9c-416a-8366-27e7bd9a9f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.095161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-3522ab01-0a9c-416a-8366-27e7bd9a9f2f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:15:47.096393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3522ab01-0a9c-416a-8366-27e7bd9a9f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:15:47.104410 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 629/1246] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:15:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:15:47.133718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50227022-fbdb-49d0-938a-e62b7b5bb553 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.147566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50227022-fbdb-49d0-938a-e62b7b5bb553 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.152754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9854d-814f-450d-bdcc-df9a02b12c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.153569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9854d-814f-450d-bdcc-df9a02b12c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.153847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9854d-814f-450d-bdcc-df9a02b12c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.154247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9854d-814f-450d-bdcc-df9a02b12c50 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.165626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9854d-814f-450d-bdcc-df9a02b12c50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:15:47.173540 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-48c9854d-814f-450d-bdcc-df9a02b12c50 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:15:47.175007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 618/1247] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:47.182311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522ab01-0a9c-416a-8366-27e7bd9a9f2f None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.191994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522ab01-0a9c-416a-8366-27e7bd9a9f2f None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.197600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc21b5-9fba-437a-9e9a-dfe44aaf1ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.198268 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc21b5-9fba-437a-9e9a-dfe44aaf1ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.198547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc21b5-9fba-437a-9e9a-dfe44aaf1ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.198821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc21b5-9fba-437a-9e9a-dfe44aaf1ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.199586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc21b5-9fba-437a-9e9a-dfe44aaf1ad9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:47.199883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc21b5-9fba-437a-9e9a-dfe44aaf1ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.201498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc21b5-9fba-437a-9e9a-dfe44aaf1ad9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.213256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 630/1248] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:47.216086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9854d-814f-450d-bdcc-df9a02b12c50 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.226446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9854d-814f-450d-bdcc-df9a02b12c50 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.231154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6727bd-da6f-4cb4-b62e-477e5c723b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.231932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6727bd-da6f-4cb4-b62e-477e5c723b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.232214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6727bd-da6f-4cb4-b62e-477e5c723b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.232487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6727bd-da6f-4cb4-b62e-477e5c723b1f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.243961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6727bd-da6f-4cb4-b62e-477e5c723b1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.245862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6727bd-da6f-4cb4-b62e-477e5c723b1f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.262464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-db6727bd-da6f-4cb4-b62e-477e5c723b1f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:47.264590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 619/1249] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 28 01:15:47.269630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc21b5-9fba-437a-9e9a-dfe44aaf1ad9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.279423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc21b5-9fba-437a-9e9a-dfe44aaf1ad9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.284641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231259a8-fd11-425f-9cc9-ae186abb9a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.285288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231259a8-fd11-425f-9cc9-ae186abb9a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.285608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231259a8-fd11-425f-9cc9-ae186abb9a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.286062 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231259a8-fd11-425f-9cc9-ae186abb9a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.286841 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231259a8-fd11-425f-9cc9-ae186abb9a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:47.287268 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231259a8-fd11-425f-9cc9-ae186abb9a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.289525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231259a8-fd11-425f-9cc9-ae186abb9a6b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.302427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 631/1250] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:47.308176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6727bd-da6f-4cb4-b62e-477e5c723b1f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.319328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6727bd-da6f-4cb4-b62e-477e5c723b1f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.324247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbaecc-6918-4428-8b6a-06d6aece8f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.325117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbaecc-6918-4428-8b6a-06d6aece8f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.325449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbaecc-6918-4428-8b6a-06d6aece8f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.325717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbaecc-6918-4428-8b6a-06d6aece8f13 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.334041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbaecc-6918-4428-8b6a-06d6aece8f13 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.336079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbaecc-6918-4428-8b6a-06d6aece8f13 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.350415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-52bbaecc-6918-4428-8b6a-06d6aece8f13 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:15:47.351665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 620/1251] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:47.358099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231259a8-fd11-425f-9cc9-ae186abb9a6b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.368459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231259a8-fd11-425f-9cc9-ae186abb9a6b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.373116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0c7b2-95e0-4638-9955-6b60883320eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.373830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0c7b2-95e0-4638-9955-6b60883320eb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.374092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0c7b2-95e0-4638-9955-6b60883320eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.374392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0c7b2-95e0-4638-9955-6b60883320eb admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.375389 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0c7b2-95e0-4638-9955-6b60883320eb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:47.375775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0c7b2-95e0-4638-9955-6b60883320eb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.377835 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0c7b2-95e0-4638-9955-6b60883320eb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.396705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 632/1252] 10.222.0.16 () {56 vars in 1164 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:47.402916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbaecc-6918-4428-8b6a-06d6aece8f13 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.413345 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbaecc-6918-4428-8b6a-06d6aece8f13 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.418087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d3f1f-ac9f-4597-9d02-67dbac93eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.418730 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d3f1f-ac9f-4597-9d02-67dbac93eb37 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.419007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d3f1f-ac9f-4597-9d02-67dbac93eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.419277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d3f1f-ac9f-4597-9d02-67dbac93eb37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.427834 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d3f1f-ac9f-4597-9d02-67dbac93eb37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.429701 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d3f1f-ac9f-4597-9d02-67dbac93eb37 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.444530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 621/1253] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:15:47.446077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0c7b2-95e0-4638-9955-6b60883320eb admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.456368 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0c7b2-95e0-4638-9955-6b60883320eb admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.461301 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cc2ae-672d-4b05-9eae-3d075031f456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.462095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cc2ae-672d-4b05-9eae-3d075031f456 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.462375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cc2ae-672d-4b05-9eae-3d075031f456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.462672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cc2ae-672d-4b05-9eae-3d075031f456 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.473774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cc2ae-672d-4b05-9eae-3d075031f456 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.475611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232cc2ae-672d-4b05-9eae-3d075031f456 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.492834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-232cc2ae-672d-4b05-9eae-3d075031f456 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:47.494159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 633/1254] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:47.500663 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d3f1f-ac9f-4597-9d02-67dbac93eb37 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.514261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d3f1f-ac9f-4597-9d02-67dbac93eb37 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.521372 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ea5c5-d64a-4c33-99bf-24149bc71b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.522022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ea5c5-d64a-4c33-99bf-24149bc71b1a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.522300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ea5c5-d64a-4c33-99bf-24149bc71b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.522570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ea5c5-d64a-4c33-99bf-24149bc71b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.523542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ea5c5-d64a-4c33-99bf-24149bc71b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:47.523848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ea5c5-d64a-4c33-99bf-24149bc71b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.525655 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ea5c5-d64a-4c33-99bf-24149bc71b1a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.538956 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 622/1255] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:47.544903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cc2ae-672d-4b05-9eae-3d075031f456 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.555415 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cc2ae-672d-4b05-9eae-3d075031f456 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.560755 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93c47-8b28-45c6-b694-763b4d8f0a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.561733 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93c47-8b28-45c6-b694-763b4d8f0a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.562012 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93c47-8b28-45c6-b694-763b4d8f0a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.562284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93c47-8b28-45c6-b694-763b4d8f0a1d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.569525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b93c47-8b28-45c6-b694-763b4d8f0a1d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.571735 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b93c47-8b28-45c6-b694-763b4d8f0a1d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.585421 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-78b93c47-8b28-45c6-b694-763b4d8f0a1d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:15:47.586791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 634/1256] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:47.593187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ea5c5-d64a-4c33-99bf-24149bc71b1a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.604131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ea5c5-d64a-4c33-99bf-24149bc71b1a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.609286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcf644-2468-4dbd-bde9-27d7345409a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.609940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf644-2468-4dbd-bde9-27d7345409a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.610220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf644-2468-4dbd-bde9-27d7345409a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.610492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcf644-2468-4dbd-bde9-27d7345409a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.612513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcf644-2468-4dbd-bde9-27d7345409a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:47.612513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcf644-2468-4dbd-bde9-27d7345409a6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.613734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcf644-2468-4dbd-bde9-27d7345409a6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.628797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 623/1257] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:47.635890 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93c47-8b28-45c6-b694-763b4d8f0a1d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:47.648002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93c47-8b28-45c6-b694-763b4d8f0a1d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:47.653187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d495338-2c89-48ca-8fec-2c1f1b4ae791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:47.653882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d495338-2c89-48ca-8fec-2c1f1b4ae791 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:47.654159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d495338-2c89-48ca-8fec-2c1f1b4ae791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:47.654431 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d495338-2c89-48ca-8fec-2c1f1b4ae791 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:47.655298 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d495338-2c89-48ca-8fec-2c1f1b4ae791 admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=aac3e041554a4439bfa91520e52fbd2e) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:47.655609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d495338-2c89-48ca-8fec-2c1f1b4ae791 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:47.657491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d495338-2c89-48ca-8fec-2c1f1b4ae791 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:47.677933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 635/1258] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:15:47 2022] GET /identity/v3/role_assignments?user.id=aac3e041554a4439bfa91520e52fbd2e&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:50.038322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb77c-69bb-401f-b2b8-90d19a0e0529 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.038871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb77c-69bb-401f-b2b8-90d19a0e0529 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.038871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb77c-69bb-401f-b2b8-90d19a0e0529 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.040656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 624/1259] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:15:50.046311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb112dc-2d13-4d31-a386-5a1188a477fb None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.046756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb112dc-2d13-4d31-a386-5a1188a477fb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.046847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb112dc-2d13-4d31-a386-5a1188a477fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.065158 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-0fb112dc-2d13-4d31-a386-5a1188a477fb None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:15:50.066453 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0fb112dc-2d13-4d31-a386-5a1188a477fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:15:50.075006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 636/1260] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:15:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:15:50.098683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddb77c-69bb-401f-b2b8-90d19a0e0529 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.112196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddb77c-69bb-401f-b2b8-90d19a0e0529 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.117166 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cd84d-7a75-4b03-b780-e20d559a2b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.117984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cd84d-7a75-4b03-b780-e20d559a2b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.118260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cd84d-7a75-4b03-b780-e20d559a2b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.118534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cd84d-7a75-4b03-b780-e20d559a2b50 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.130948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cd84d-7a75-4b03-b780-e20d559a2b50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:15:50.138553 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e49cd84d-7a75-4b03-b780-e20d559a2b50 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:15:50.139819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 625/1261] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:15:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:50.146113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb112dc-2d13-4d31-a386-5a1188a477fb None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.155017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb112dc-2d13-4d31-a386-5a1188a477fb None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.159566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6be13-b6f4-4ec7-a83a-e7f04c19d4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.160219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6be13-b6f4-4ec7-a83a-e7f04c19d4be admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.160492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6be13-b6f4-4ec7-a83a-e7f04c19d4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.160755 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6be13-b6f4-4ec7-a83a-e7f04c19d4be admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.161611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6be13-b6f4-4ec7-a83a-e7f04c19d4be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:50.161905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6be13-b6f4-4ec7-a83a-e7f04c19d4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:50.163502 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6be13-b6f4-4ec7-a83a-e7f04c19d4be admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:50.172571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 637/1262] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:15:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:50.178551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cd84d-7a75-4b03-b780-e20d559a2b50 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.190755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cd84d-7a75-4b03-b780-e20d559a2b50 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.195877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c87b7-7a2b-4e53-b33e-709084a833bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.196676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c87b7-7a2b-4e53-b33e-709084a833bb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.196983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c87b7-7a2b-4e53-b33e-709084a833bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.197219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c87b7-7a2b-4e53-b33e-709084a833bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.208815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c87b7-7a2b-4e53-b33e-709084a833bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:50.210863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c87b7-7a2b-4e53-b33e-709084a833bb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:50.230708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-df0c87b7-7a2b-4e53-b33e-709084a833bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:50.232306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 626/1263] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:50.240834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6be13-b6f4-4ec7-a83a-e7f04c19d4be admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.250872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6be13-b6f4-4ec7-a83a-e7f04c19d4be admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.256120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871d27a-9ca2-41cf-a9a8-ac765383f34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.256861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871d27a-9ca2-41cf-a9a8-ac765383f34e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.257201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871d27a-9ca2-41cf-a9a8-ac765383f34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.257613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871d27a-9ca2-41cf-a9a8-ac765383f34e admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.258456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871d27a-9ca2-41cf-a9a8-ac765383f34e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:50.258871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871d27a-9ca2-41cf-a9a8-ac765383f34e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:50.260502 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871d27a-9ca2-41cf-a9a8-ac765383f34e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:50.273882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 638/1264] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:15:50.278763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c87b7-7a2b-4e53-b33e-709084a833bb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.289192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c87b7-7a2b-4e53-b33e-709084a833bb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.294061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7897a35-d660-4ce2-917b-cbcba49919ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.294856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897a35-d660-4ce2-917b-cbcba49919ba admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.295132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897a35-d660-4ce2-917b-cbcba49919ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.295399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7897a35-d660-4ce2-917b-cbcba49919ba admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.303565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7897a35-d660-4ce2-917b-cbcba49919ba admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:50.305698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7897a35-d660-4ce2-917b-cbcba49919ba admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:50.321280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-e7897a35-d660-4ce2-917b-cbcba49919ba admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:15:50.322541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 627/1265] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:50.329614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871d27a-9ca2-41cf-a9a8-ac765383f34e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.339836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871d27a-9ca2-41cf-a9a8-ac765383f34e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.345029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a458dc-53d4-4365-9d8c-a98fe2b8a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.345738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a458dc-53d4-4365-9d8c-a98fe2b8a847 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.346013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a458dc-53d4-4365-9d8c-a98fe2b8a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.346433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a458dc-53d4-4365-9d8c-a98fe2b8a847 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.347140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a458dc-53d4-4365-9d8c-a98fe2b8a847 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:50.347447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a458dc-53d4-4365-9d8c-a98fe2b8a847 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:50.349385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a458dc-53d4-4365-9d8c-a98fe2b8a847 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:50.368506 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 639/1266] 10.222.0.16 () {56 vars in 1164 bytes} [Fri Jan 28 01:15:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:50.374729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7897a35-d660-4ce2-917b-cbcba49919ba admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.385661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7897a35-d660-4ce2-917b-cbcba49919ba admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.391604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be2686-7970-4bb5-bbad-1a6b4bb3f8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.392425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be2686-7970-4bb5-bbad-1a6b4bb3f8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.392697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be2686-7970-4bb5-bbad-1a6b4bb3f8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.393046 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be2686-7970-4bb5-bbad-1a6b4bb3f8a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.404015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be2686-7970-4bb5-bbad-1a6b4bb3f8a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:50.405843 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be2686-7970-4bb5-bbad-1a6b4bb3f8a8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:50.422756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-61be2686-7970-4bb5-bbad-1a6b4bb3f8a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:50.424080 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 628/1267] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:50.430100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a458dc-53d4-4365-9d8c-a98fe2b8a847 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.440614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a458dc-53d4-4365-9d8c-a98fe2b8a847 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.445917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0fe11-14ce-4c13-aab8-27887cee3432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.446738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fe11-14ce-4c13-aab8-27887cee3432 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.447092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fe11-14ce-4c13-aab8-27887cee3432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.447656 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fe11-14ce-4c13-aab8-27887cee3432 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.448579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0fe11-14ce-4c13-aab8-27887cee3432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:50.448859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0fe11-14ce-4c13-aab8-27887cee3432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:50.450859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0fe11-14ce-4c13-aab8-27887cee3432 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:50.464953 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 640/1268] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:50.471326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be2686-7970-4bb5-bbad-1a6b4bb3f8a8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.481814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be2686-7970-4bb5-bbad-1a6b4bb3f8a8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.486810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e97a00-c3d1-41eb-a7ae-648357dd92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.487630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e97a00-c3d1-41eb-a7ae-648357dd92d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.487919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e97a00-c3d1-41eb-a7ae-648357dd92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.488234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e97a00-c3d1-41eb-a7ae-648357dd92d0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.495874 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e97a00-c3d1-41eb-a7ae-648357dd92d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:50.497998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e97a00-c3d1-41eb-a7ae-648357dd92d0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:50.510959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-c5e97a00-c3d1-41eb-a7ae-648357dd92d0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:15:50.512230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 629/1269] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:15:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:50.518305 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0fe11-14ce-4c13-aab8-27887cee3432 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.528466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0fe11-14ce-4c13-aab8-27887cee3432 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.533644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36326dc-536a-4334-b135-5241abc636df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.534382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36326dc-536a-4334-b135-5241abc636df admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.534687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36326dc-536a-4334-b135-5241abc636df admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.534921 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36326dc-536a-4334-b135-5241abc636df admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.535856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36326dc-536a-4334-b135-5241abc636df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:50.536119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36326dc-536a-4334-b135-5241abc636df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:50.538022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36326dc-536a-4334-b135-5241abc636df admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:50.551401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 641/1270] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:15:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:50.557562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e97a00-c3d1-41eb-a7ae-648357dd92d0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:50.568769 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e97a00-c3d1-41eb-a7ae-648357dd92d0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:50.573735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60f2da-8a3a-44fc-89d0-f9545d410b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:50.574920 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60f2da-8a3a-44fc-89d0-f9545d410b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:50.575296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60f2da-8a3a-44fc-89d0-f9545d410b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:50.575682 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60f2da-8a3a-44fc-89d0-f9545d410b6c admin admin] PATH_INFO: `/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/aac3e041554a4439bfa91520e52fbd2e/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:50.578775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60f2da-8a3a-44fc-89d0-f9545d410b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=469b0b155bdc49d7b8c5a3294f4f7120, user_id=aac3e041554a4439bfa91520e52fbd2e, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:50.583143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60f2da-8a3a-44fc-89d0-f9545d410b6c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:50.602239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 630/1271] 10.222.0.16 () {58 vars in 1460 bytes} [Fri Jan 28 01:15:50 2022] PUT /identity/v3/projects/469b0b155bdc49d7b8c5a3294f4f7120/users/aac3e041554a4439bfa91520e52fbd2e/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:15:52.841856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb1dd-0430-46e0-bdd7-e50c110c9fdb None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:52.842417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb1dd-0430-46e0-bdd7-e50c110c9fdb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:52.842417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbb1dd-0430-46e0-bdd7-e50c110c9fdb None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:52.845420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 642/1272] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:15:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:15:52.850995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccf89-abca-4b8b-86a8-37a59d9fa7c5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:52.851471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccf89-abca-4b8b-86a8-37a59d9fa7c5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:52.851560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccf89-abca-4b8b-86a8-37a59d9fa7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:52.868842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-bdeccf89-abca-4b8b-86a8-37a59d9fa7c5 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:15:52.870066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bdeccf89-abca-4b8b-86a8-37a59d9fa7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:15:52.939806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 631/1273] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:15:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:15:52.966031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbb1dd-0430-46e0-bdd7-e50c110c9fdb None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:52.979189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbb1dd-0430-46e0-bdd7-e50c110c9fdb None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:52.983598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b9ba-f2f0-4903-b33a-3a3d101a8045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:52.984402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b9ba-f2f0-4903-b33a-3a3d101a8045 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:52.984684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b9ba-f2f0-4903-b33a-3a3d101a8045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:52.984954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b9ba-f2f0-4903-b33a-3a3d101a8045 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:52.996829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b9ba-f2f0-4903-b33a-3a3d101a8045 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 28 01:15:53.003891 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-8be1b9ba-f2f0-4903-b33a-3a3d101a8045 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 28 01:15:53.005252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 643/1274] 10.222.0.16 () {56 vars in 1117 bytes} [Fri Jan 28 01:15:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:53.011732 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeccf89-abca-4b8b-86a8-37a59d9fa7c5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.021433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeccf89-abca-4b8b-86a8-37a59d9fa7c5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.027167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0ae7b-38d8-41c6-84f0-d12ecdd92299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.027973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0ae7b-38d8-41c6-84f0-d12ecdd92299 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.028258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0ae7b-38d8-41c6-84f0-d12ecdd92299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.028529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0ae7b-38d8-41c6-84f0-d12ecdd92299 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.029331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0ae7b-38d8-41c6-84f0-d12ecdd92299 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:53.029639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0ae7b-38d8-41c6-84f0-d12ecdd92299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.031226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0ae7b-38d8-41c6-84f0-d12ecdd92299 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.045803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 632/1275] 10.222.0.16 () {56 vars in 1120 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:53.047192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b9ba-f2f0-4903-b33a-3a3d101a8045 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.058893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b9ba-f2f0-4903-b33a-3a3d101a8045 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.064564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557e32-be48-4fb9-bd1e-4e15626285a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.065436 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557e32-be48-4fb9-bd1e-4e15626285a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.065709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557e32-be48-4fb9-bd1e-4e15626285a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.065973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557e32-be48-4fb9-bd1e-4e15626285a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.078107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97557e32-be48-4fb9-bd1e-4e15626285a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.080068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97557e32-be48-4fb9-bd1e-4e15626285a9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.099292 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-97557e32-be48-4fb9-bd1e-4e15626285a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:53.100578 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 644/1276] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:53.106726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0ae7b-38d8-41c6-84f0-d12ecdd92299 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.117530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0ae7b-38d8-41c6-84f0-d12ecdd92299 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.123233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5fe1f-f1bf-4872-a521-ed88fb1523b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.123925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5fe1f-f1bf-4872-a521-ed88fb1523b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.124207 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5fe1f-f1bf-4872-a521-ed88fb1523b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.124478 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5fe1f-f1bf-4872-a521-ed88fb1523b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.125254 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5fe1f-f1bf-4872-a521-ed88fb1523b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:53.125560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5fe1f-f1bf-4872-a521-ed88fb1523b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.127171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5fe1f-f1bf-4872-a521-ed88fb1523b8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.146559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 633/1277] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:53.147940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557e32-be48-4fb9-bd1e-4e15626285a9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.158691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557e32-be48-4fb9-bd1e-4e15626285a9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.164615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5ce6-2307-40f8-b002-4368dc5d2038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.165486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5ce6-2307-40f8-b002-4368dc5d2038 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.165751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5ce6-2307-40f8-b002-4368dc5d2038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.166015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5ce6-2307-40f8-b002-4368dc5d2038 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.174792 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c5ce6-2307-40f8-b002-4368dc5d2038 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.176840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c5ce6-2307-40f8-b002-4368dc5d2038 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.192678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-203c5ce6-2307-40f8-b002-4368dc5d2038 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 28 01:15:53.193861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 645/1278] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:53.200196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5fe1f-f1bf-4872-a521-ed88fb1523b8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.210857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5fe1f-f1bf-4872-a521-ed88fb1523b8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.216630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c2457-c25d-43a2-93be-ee54f862afba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.217351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2457-c25d-43a2-93be-ee54f862afba admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.217628 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2457-c25d-43a2-93be-ee54f862afba admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.217901 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2457-c25d-43a2-93be-ee54f862afba admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.218758 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2457-c25d-43a2-93be-ee54f862afba admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:53.219064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2457-c25d-43a2-93be-ee54f862afba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.221296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2457-c25d-43a2-93be-ee54f862afba admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.246167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 634/1279] 10.222.0.16 () {56 vars in 1164 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:53.247521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5ce6-2307-40f8-b002-4368dc5d2038 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.258151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5ce6-2307-40f8-b002-4368dc5d2038 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.263745 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5155e05-4980-4c8c-894b-80ce380f1a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.264488 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5155e05-4980-4c8c-894b-80ce380f1a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.264827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5155e05-4980-4c8c-894b-80ce380f1a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.265157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5155e05-4980-4c8c-894b-80ce380f1a65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.274122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5155e05-4980-4c8c-894b-80ce380f1a65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.275890 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5155e05-4980-4c8c-894b-80ce380f1a65 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.289251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 646/1280] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:15:53.291403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c2457-c25d-43a2-93be-ee54f862afba admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.301583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c2457-c25d-43a2-93be-ee54f862afba admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.306991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3acbc-9c69-473f-8321-0157c38a2d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.307780 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3acbc-9c69-473f-8321-0157c38a2d31 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.308059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3acbc-9c69-473f-8321-0157c38a2d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.308359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3acbc-9c69-473f-8321-0157c38a2d31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.319017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3acbc-9c69-473f-8321-0157c38a2d31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.320843 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3acbc-9c69-473f-8321-0157c38a2d31 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.337852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-bef3acbc-9c69-473f-8321-0157c38a2d31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 28 01:15:53.339085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 635/1281] 10.222.0.16 () {56 vars in 1129 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:53.345177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5155e05-4980-4c8c-894b-80ce380f1a65 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.354545 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5155e05-4980-4c8c-894b-80ce380f1a65 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.359416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11744f6-b614-4fbc-992f-d2d5b6ea0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.360071 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11744f6-b614-4fbc-992f-d2d5b6ea0426 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.360344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11744f6-b614-4fbc-992f-d2d5b6ea0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.360610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11744f6-b614-4fbc-992f-d2d5b6ea0426 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.361370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11744f6-b614-4fbc-992f-d2d5b6ea0426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:53.361669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11744f6-b614-4fbc-992f-d2d5b6ea0426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.363217 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11744f6-b614-4fbc-992f-d2d5b6ea0426 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.376039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 647/1282] 10.222.0.16 () {56 vars in 1130 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:15:53.380988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3acbc-9c69-473f-8321-0157c38a2d31 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.390804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3acbc-9c69-473f-8321-0157c38a2d31 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.395321 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdbfb6-1932-4660-904e-b5b15b81cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.396084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdbfb6-1932-4660-904e-b5b15b81cb4e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.396357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdbfb6-1932-4660-904e-b5b15b81cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.396619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdbfb6-1932-4660-904e-b5b15b81cb4e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.403572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdbfb6-1932-4660-904e-b5b15b81cb4e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.405521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdbfb6-1932-4660-904e-b5b15b81cb4e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.418487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING keystone.server.flask.application [None req-63bdbfb6-1932-4660-904e-b5b15b81cb4e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 28 01:15:53.419648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 636/1283] 10.222.0.16 () {56 vars in 1132 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:53.425604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11744f6-b614-4fbc-992f-d2d5b6ea0426 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.435541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11744f6-b614-4fbc-992f-d2d5b6ea0426 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.440120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe503-1818-4bc3-9c1d-b6a1b568b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.440775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe503-1818-4bc3-9c1d-b6a1b568b629 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.441088 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe503-1818-4bc3-9c1d-b6a1b568b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.441386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe503-1818-4bc3-9c1d-b6a1b568b629 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.442266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fe503-1818-4bc3-9c1d-b6a1b568b629 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:53.442605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fe503-1818-4bc3-9c1d-b6a1b568b629 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.444467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fe503-1818-4bc3-9c1d-b6a1b568b629 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.457035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 648/1284] 10.222.0.16 () {56 vars in 1169 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:53.463160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdbfb6-1932-4660-904e-b5b15b81cb4e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:53.473935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdbfb6-1932-4660-904e-b5b15b81cb4e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:53.478451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e92505-2ded-4142-8e91-ecdd776149ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:53.479056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92505-2ded-4142-8e91-ecdd776149ae admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:53.479325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92505-2ded-4142-8e91-ecdd776149ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:53.479588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e92505-2ded-4142-8e91-ecdd776149ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:53.480413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92505-2ded-4142-8e91-ecdd776149ae admin admin] RBAC: Adding query filter params (role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e, scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120, user.id=aac3e041554a4439bfa91520e52fbd2e) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:53.480714 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92505-2ded-4142-8e91-ecdd776149ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:53.482571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e92505-2ded-4142-8e91-ecdd776149ae admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:53.488485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 637/1285] 10.222.0.16 () {56 vars in 1395 bytes} [Fri Jan 28 01:15:53 2022] GET /identity/v3/role_assignments?user.id=aac3e041554a4439bfa91520e52fbd2e&scope.project.id=469b0b155bdc49d7b8c5a3294f4f7120&role.id=a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:55.732041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d816-b8a4-4851-9e47-a707dddda024 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:55.732870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d816-b8a4-4851-9e47-a707dddda024 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:55.732870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d816-b8a4-4851-9e47-a707dddda024 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:55.735773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 649/1286] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:15:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:15:55.741195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7360768-700a-450e-b939-164cbdc119aa None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:55.741666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7360768-700a-450e-b939-164cbdc119aa None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:55.741758 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7360768-700a-450e-b939-164cbdc119aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:55.760428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d7360768-700a-450e-b939-164cbdc119aa None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:15:55.761626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d7360768-700a-450e-b939-164cbdc119aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:15:55.770149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 638/1287] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:15:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:15:55.792498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d816-b8a4-4851-9e47-a707dddda024 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:55.806614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d816-b8a4-4851-9e47-a707dddda024 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:55.811779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf178-38d5-4639-9c0d-1d1e39fa01b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:55.812542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf178-38d5-4639-9c0d-1d1e39fa01b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:55.812816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf178-38d5-4639-9c0d-1d1e39fa01b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:55.813080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf178-38d5-4639-9c0d-1d1e39fa01b2 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:55.813772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcf178-38d5-4639-9c0d-1d1e39fa01b2 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:55.815349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcf178-38d5-4639-9c0d-1d1e39fa01b2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:55.829036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-ecdcf178-38d5-4639-9c0d-1d1e39fa01b2 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:15:55.829434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 650/1288] 10.222.0.16 () {56 vars in 1138 bytes} [Fri Jan 28 01:15:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:15:55.835274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7360768-700a-450e-b939-164cbdc119aa None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:55.845260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7360768-700a-450e-b939-164cbdc119aa None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:55.850501 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da01f88-9ce4-4117-9d39-c2f1c88dde0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:55.851138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01f88-9ce4-4117-9d39-c2f1c88dde0c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:55.851412 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01f88-9ce4-4117-9d39-c2f1c88dde0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:55.851677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01f88-9ce4-4117-9d39-c2f1c88dde0c admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:55.852387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da01f88-9ce4-4117-9d39-c2f1c88dde0c admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:55.852687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da01f88-9ce4-4117-9d39-c2f1c88dde0c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:55.854287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da01f88-9ce4-4117-9d39-c2f1c88dde0c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:55.859615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 639/1289] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jan 28 01:15:55 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:55.865080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf178-38d5-4639-9c0d-1d1e39fa01b2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:55.875416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf178-38d5-4639-9c0d-1d1e39fa01b2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:55.880912 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152158a-8f1a-4494-85d8-eb7a339c4de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:55.881524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152158a-8f1a-4494-85d8-eb7a339c4de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:55.881809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152158a-8f1a-4494-85d8-eb7a339c4de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:55.882084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152158a-8f1a-4494-85d8-eb7a339c4de4 admin admin] PATH_INFO: `/v3/services` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:55.882802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152158a-8f1a-4494-85d8-eb7a339c4de4 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:15:55.883104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152158a-8f1a-4494-85d8-eb7a339c4de4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:55.884814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152158a-8f1a-4494-85d8-eb7a339c4de4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:55.889594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 651/1290] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jan 28 01:15:55 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:15:58.131365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece565-de44-482e-9ec6-a36f2533e045 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:58.131947 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece565-de44-482e-9ec6-a36f2533e045 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:58.132063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ece565-de44-482e-9ec6-a36f2533e045 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:58.134343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 640/1291] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:15:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:15:58.141685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f10af-2144-451a-8a01-2b7dcb8b7618 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:58.142295 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f10af-2144-451a-8a01-2b7dcb8b7618 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:58.142493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f10af-2144-451a-8a01-2b7dcb8b7618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:58.166743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-3d4f10af-2144-451a-8a01-2b7dcb8b7618 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:15:58.168492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3d4f10af-2144-451a-8a01-2b7dcb8b7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:15:58.180188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 652/1292] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:15:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:15:58.214576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece565-de44-482e-9ec6-a36f2533e045 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:15:58.235298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ece565-de44-482e-9ec6-a36f2533e045 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:15:58.242636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d078-0abc-4c2b-acce-f3dedf069987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:15:58.243313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d078-0abc-4c2b-acce-f3dedf069987 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:15:58.243665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d078-0abc-4c2b-acce-f3dedf069987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:15:58.243937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d078-0abc-4c2b-acce-f3dedf069987 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:15:58.244685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d078-0abc-4c2b-acce-f3dedf069987 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:15:58.246336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d078-0abc-4c2b-acce-f3dedf069987 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:15:58.262962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 641/1293] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Jan 28 01:15:58 2022] POST /identity/v3/services => generated 246 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:16:00.444782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936861fa-d02f-417b-a8ec-8d1c062f2ecb None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:00.445382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936861fa-d02f-417b-a8ec-8d1c062f2ecb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:00.445382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936861fa-d02f-417b-a8ec-8d1c062f2ecb None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:00.447110 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 653/1294] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:16:00.455949 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8573507-a957-4a02-85de-beb9e560da86 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:00.456649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8573507-a957-4a02-85de-beb9e560da86 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:00.456793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8573507-a957-4a02-85de-beb9e560da86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:00.475952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c8573507-a957-4a02-85de-beb9e560da86 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:16:00.477149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c8573507-a957-4a02-85de-beb9e560da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:16:00.496037 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 642/1295] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:16:00.519200 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936861fa-d02f-417b-a8ec-8d1c062f2ecb None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:16:00.534826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936861fa-d02f-417b-a8ec-8d1c062f2ecb None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:16:00.540741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e68c2d-e666-4077-81b4-1eaaa5f8eff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:16:00.541614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e68c2d-e666-4077-81b4-1eaaa5f8eff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:00.541895 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e68c2d-e666-4077-81b4-1eaaa5f8eff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:00.542178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e68c2d-e666-4077-81b4-1eaaa5f8eff5 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:00.542844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e68c2d-e666-4077-81b4-1eaaa5f8eff5 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:16:00.544442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e68c2d-e666-4077-81b4-1eaaa5f8eff5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:16:00.555637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-a4e68c2d-e666-4077-81b4-1eaaa5f8eff5 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:16:00.556743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 654/1296] 10.222.0.16 () {56 vars in 1138 bytes} [Fri Jan 28 01:16:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:16:00.566095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8573507-a957-4a02-85de-beb9e560da86 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:16:00.575481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8573507-a957-4a02-85de-beb9e560da86 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:16:00.582990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2aaa4-d583-44c0-a185-505ad937de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:16:00.583637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2aaa4-d583-44c0-a185-505ad937de3e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:00.583911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2aaa4-d583-44c0-a185-505ad937de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:00.584180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2aaa4-d583-44c0-a185-505ad937de3e admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:00.584903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2aaa4-d583-44c0-a185-505ad937de3e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:16:00.585207 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2aaa4-d583-44c0-a185-505ad937de3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:16:00.586815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2aaa4-d583-44c0-a185-505ad937de3e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:16:00.592677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 643/1297] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jan 28 01:16:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:16:00.600864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e68c2d-e666-4077-81b4-1eaaa5f8eff5 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:16:00.610805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e68c2d-e666-4077-81b4-1eaaa5f8eff5 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:16:00.616917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380c9c3-07a6-43e6-93e7-ce35f00b2a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:16:00.617585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380c9c3-07a6-43e6-93e7-ce35f00b2a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:00.617860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380c9c3-07a6-43e6-93e7-ce35f00b2a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:00.618129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380c9c3-07a6-43e6-93e7-ce35f00b2a49 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:00.618953 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380c9c3-07a6-43e6-93e7-ce35f00b2a49 admin admin] RBAC: Adding query filter params (interface=public, service_id=9a098cde2e99405382c5060ecfbde445, region_id=RegionOne) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:16:00.619256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380c9c3-07a6-43e6-93e7-ce35f00b2a49 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:16:00.620837 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380c9c3-07a6-43e6-93e7-ce35f00b2a49 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:16:00.626153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 655/1298] 10.222.0.16 () {56 vars in 1272 bytes} [Fri Jan 28 01:16:00 2022] GET /identity/v3/endpoints?service_id=9a098cde2e99405382c5060ecfbde445&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:16:00.631598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2aaa4-d583-44c0-a185-505ad937de3e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:16:00.641130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2aaa4-d583-44c0-a185-505ad937de3e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:16:00.647013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d7731-cb8d-42b0-9137-978957867a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:16:00.647653 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d7731-cb8d-42b0-9137-978957867a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:00.647928 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d7731-cb8d-42b0-9137-978957867a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:00.648203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d7731-cb8d-42b0-9137-978957867a47 admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:00.648886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d7731-cb8d-42b0-9137-978957867a47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:16:00.650524 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d7731-cb8d-42b0-9137-978957867a47 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:16:00.657559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 644/1299] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:16:00 2022] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:16:02.822930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ebc2-f5cd-4f3e-af35-4d6faf454038 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:02.823825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ebc2-f5cd-4f3e-af35-4d6faf454038 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:02.823825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ebc2-f5cd-4f3e-af35-4d6faf454038 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:02.826710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 656/1300] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:16:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:16:02.833209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555aab5-2c68-4a49-80e4-72510ed29826 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:02.833711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555aab5-2c68-4a49-80e4-72510ed29826 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:02.833809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555aab5-2c68-4a49-80e4-72510ed29826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:02.857971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4555aab5-2c68-4a49-80e4-72510ed29826 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:16:02.859146 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4555aab5-2c68-4a49-80e4-72510ed29826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:16:02.867456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 645/1301] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:16:02.896079 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ebc2-f5cd-4f3e-af35-4d6faf454038 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:16:02.913646 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ebc2-f5cd-4f3e-af35-4d6faf454038 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:16:02.919098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dbff0-fc6d-4839-93ed-302dd64dab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:16:02.919964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dbff0-fc6d-4839-93ed-302dd64dab16 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:02.920269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dbff0-fc6d-4839-93ed-302dd64dab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:02.920598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dbff0-fc6d-4839-93ed-302dd64dab16 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:02.921420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dbff0-fc6d-4839-93ed-302dd64dab16 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:16:02.923374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dbff0-fc6d-4839-93ed-302dd64dab16 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:16:02.935901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING keystone.server.flask.application [None req-9e4dbff0-fc6d-4839-93ed-302dd64dab16 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 28 01:16:02.937174 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 657/1302] 10.222.0.16 () {56 vars in 1138 bytes} [Fri Jan 28 01:16:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 28 01:16:02.943579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555aab5-2c68-4a49-80e4-72510ed29826 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:16:02.953192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555aab5-2c68-4a49-80e4-72510ed29826 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:16:02.958559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e501d4a-f7bd-4496-883e-72a4a84c3eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:16:02.959248 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e501d4a-f7bd-4496-883e-72a4a84c3eea admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:02.959556 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e501d4a-f7bd-4496-883e-72a4a84c3eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:02.960024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e501d4a-f7bd-4496-883e-72a4a84c3eea admin admin] PATH_INFO: `/v3/services` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:02.960882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e501d4a-f7bd-4496-883e-72a4a84c3eea admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:16:02.961327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e501d4a-f7bd-4496-883e-72a4a84c3eea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:16:02.962985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e501d4a-f7bd-4496-883e-72a4a84c3eea admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:16:02.968642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 646/1303] 10.222.0.16 () {56 vars in 1137 bytes} [Fri Jan 28 01:16:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:16:02.975926 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dbff0-fc6d-4839-93ed-302dd64dab16 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:16:02.990294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dbff0-fc6d-4839-93ed-302dd64dab16 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:16:02.997719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06216f90-a47d-4669-8fa6-08ac1507d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:16:02.998678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216f90-a47d-4669-8fa6-08ac1507d24f admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:16:02.999097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216f90-a47d-4669-8fa6-08ac1507d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:16:02.999522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216f90-a47d-4669-8fa6-08ac1507d24f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:16:03.000665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06216f90-a47d-4669-8fa6-08ac1507d24f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:16:03.003296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06216f90-a47d-4669-8fa6-08ac1507d24f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:16:03.024560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 658/1304] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Jan 28 01:16:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:17:06.506132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642acbe-680d-4f9d-b517-4d7113491f81 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:06.507375 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642acbe-680d-4f9d-b517-4d7113491f81 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:06.507849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642acbe-680d-4f9d-b517-4d7113491f81 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:06.515047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 647/1305] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:06.517763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f89ff0-4ef4-420e-9ff3-39366c1930c7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:06.518278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f89ff0-4ef4-420e-9ff3-39366c1930c7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:06.518750 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f89ff0-4ef4-420e-9ff3-39366c1930c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:06.644719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-50f89ff0-4ef4-420e-9ff3-39366c1930c7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:06.646753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-50f89ff0-4ef4-420e-9ff3-39366c1930c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:06.820647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 659/1306] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:17:06.843957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642acbe-680d-4f9d-b517-4d7113491f81 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:06.845727 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8642acbe-680d-4f9d-b517-4d7113491f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:06.981441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642acbe-680d-4f9d-b517-4d7113491f81 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:07.080043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef1f47-f9bb-4bad-a2ba-433b358bd714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:07.080644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1f47-f9bb-4bad-a2ba-433b358bd714 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:07.080920 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1f47-f9bb-4bad-a2ba-433b358bd714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:07.081214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1f47-f9bb-4bad-a2ba-433b358bd714 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:07.082129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef1f47-f9bb-4bad-a2ba-433b358bd714 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:07.083962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef1f47-f9bb-4bad-a2ba-433b358bd714 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:07.105314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 648/1307] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:17:06 2022] GET /identity/v3/projects => generated 2553 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:17:09.333930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5743-ee63-4f20-99c8-733081cae65d None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:09.334524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5743-ee63-4f20-99c8-733081cae65d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:09.334524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d5743-ee63-4f20-99c8-733081cae65d None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:09.336234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 660/1308] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:09.341615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4ad32-9ef1-4328-9039-ef61e9ce6d9d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:09.342044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4ad32-9ef1-4328-9039-ef61e9ce6d9d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:09.342150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4ad32-9ef1-4328-9039-ef61e9ce6d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:09.421142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-fea4ad32-9ef1-4328-9039-ef61e9ce6d9d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:09.422352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fea4ad32-9ef1-4328-9039-ef61e9ce6d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:09.516040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 649/1309] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:09.538808 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5743-ee63-4f20-99c8-733081cae65d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:09.540327 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-214d5743-ee63-4f20-99c8-733081cae65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:09.665117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d5743-ee63-4f20-99c8-733081cae65d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:09.757212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af99b6d-f91f-4c80-b19d-3898aa58fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:09.757909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af99b6d-f91f-4c80-b19d-3898aa58fe6f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:09.758189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af99b6d-f91f-4c80-b19d-3898aa58fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:09.758483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af99b6d-f91f-4c80-b19d-3898aa58fe6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:09.759226 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af99b6d-f91f-4c80-b19d-3898aa58fe6f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:09.761072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af99b6d-f91f-4c80-b19d-3898aa58fe6f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:09.780237 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 661/1310] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:17:09 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:17:12.013363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2813b41-27a9-4fc6-932e-e793b35d3de5 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:12.013893 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2813b41-27a9-4fc6-932e-e793b35d3de5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:12.013893 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2813b41-27a9-4fc6-932e-e793b35d3de5 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:12.015839 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 650/1311] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:12.020953 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f82f-ce3c-4934-9eea-5da79bad0b17 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:12.021402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f82f-ce3c-4934-9eea-5da79bad0b17 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:12.021503 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0f82f-ce3c-4934-9eea-5da79bad0b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:12.086779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b0a0f82f-ce3c-4934-9eea-5da79bad0b17 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:12.087991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b0a0f82f-ce3c-4934-9eea-5da79bad0b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:12.183812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 662/1312] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:12.240410 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fff3e-6e44-491b-a23f-f55b936be3c3 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:12.240699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fff3e-6e44-491b-a23f-f55b936be3c3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:12.241204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fff3e-6e44-491b-a23f-f55b936be3c3 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:12.243224 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 651/1313] 10.222.0.16 () {54 vars in 964 bytes} [Fri Jan 28 01:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:17:12.248964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15b8a-6001-41d9-8801-e34070e48ede None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:12.249280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15b8a-6001-41d9-8801-e34070e48ede None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:12.249567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15b8a-6001-41d9-8801-e34070e48ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:12.332761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-94f15b8a-6001-41d9-8801-e34070e48ede None None] MFA Rules not processed for user `84470027e2824dc3a4b735d086de1300`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:12.334179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-94f15b8a-6001-41d9-8801-e34070e48ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:12.410585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 663/1314] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Jan 28 01:17:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:12.419882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fff3e-6e44-491b-a23f-f55b936be3c3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:12.421419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-476fff3e-6e44-491b-a23f-f55b936be3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:12.523194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fff3e-6e44-491b-a23f-f55b936be3c3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:12.602171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55384e4-c8f6-4bb9-b5e4-5373b2163158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:12.602806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55384e4-c8f6-4bb9-b5e4-5373b2163158 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:12.603082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55384e4-c8f6-4bb9-b5e4-5373b2163158 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:12.603358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55384e4-c8f6-4bb9-b5e4-5373b2163158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:12.604994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d55384e4-c8f6-4bb9-b5e4-5373b2163158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:12.717706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55384e4-c8f6-4bb9-b5e4-5373b2163158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:12.719494 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55384e4-c8f6-4bb9-b5e4-5373b2163158 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:12.738092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 652/1315] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:15.190354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adae72-f926-42df-a84a-85c867276c88 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:15.191226 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adae72-f926-42df-a84a-85c867276c88 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:15.191226 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adae72-f926-42df-a84a-85c867276c88 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:15.194117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 664/1316] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:15.199711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df954188-c86c-4602-a703-b3254f5ee85a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:15.200108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df954188-c86c-4602-a703-b3254f5ee85a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:15.200261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df954188-c86c-4602-a703-b3254f5ee85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:15.270456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-df954188-c86c-4602-a703-b3254f5ee85a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:15.271656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-df954188-c86c-4602-a703-b3254f5ee85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:15.379477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 653/1317] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:15.413732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adae72-f926-42df-a84a-85c867276c88 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:15.416112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-20adae72-f926-42df-a84a-85c867276c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:15.561000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adae72-f926-42df-a84a-85c867276c88 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:15.655644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f76caf-a104-48c4-a469-441ed2f039ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:15.656504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76caf-a104-48c4-a469-441ed2f039ff admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:15.656780 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76caf-a104-48c4-a469-441ed2f039ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:15.657047 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76caf-a104-48c4-a469-441ed2f039ff admin admin] PATH_INFO: `/v3/projects/890dca85d3164528880613bf0afcbf95` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:15.657996 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f76caf-a104-48c4-a469-441ed2f039ff admin admin] RBAC: Authorizing `identity:get_project(project_id=890dca85d3164528880613bf0afcbf95)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:15.659803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f76caf-a104-48c4-a469-441ed2f039ff admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:15.661523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 665/1318] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:17:15 2022] GET /identity/v3/projects/890dca85d3164528880613bf0afcbf95 => generated 344 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:17:15.676357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df954188-c86c-4602-a703-b3254f5ee85a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:15.677642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-df954188-c86c-4602-a703-b3254f5ee85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:15.771747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df954188-c86c-4602-a703-b3254f5ee85a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:15.845114 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66d14c-c6cd-45aa-a0fb-b11c7921ddee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:15.845701 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66d14c-c6cd-45aa-a0fb-b11c7921ddee service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:15.845976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66d14c-c6cd-45aa-a0fb-b11c7921ddee service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:15.846240 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66d14c-c6cd-45aa-a0fb-b11c7921ddee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:15.847875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0d66d14c-c6cd-45aa-a0fb-b11c7921ddee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:15.961654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66d14c-c6cd-45aa-a0fb-b11c7921ddee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:15.963099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66d14c-c6cd-45aa-a0fb-b11c7921ddee service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:15.981601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 654/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:18.468334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75a6f3-a533-4fa8-9525-cf522973bbf2 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:18.468922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75a6f3-a533-4fa8-9525-cf522973bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:18.468922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75a6f3-a533-4fa8-9525-cf522973bbf2 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:18.470710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 666/1320] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:18.477460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce355-3ddf-4a76-98a7-7d472882d1a6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:18.478144 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce355-3ddf-4a76-98a7-7d472882d1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:18.478345 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce355-3ddf-4a76-98a7-7d472882d1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:18.564698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c08ce355-3ddf-4a76-98a7-7d472882d1a6 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:18.565870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c08ce355-3ddf-4a76-98a7-7d472882d1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:18.675393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 655/1321] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:18.710059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75a6f3-a533-4fa8-9525-cf522973bbf2 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:18.711622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1d75a6f3-a533-4fa8-9525-cf522973bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:18.850902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75a6f3-a533-4fa8-9525-cf522973bbf2 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:18.949551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3adf4-a892-413f-982e-d49b22221882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:18.950421 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3adf4-a892-413f-982e-d49b22221882 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:18.950699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3adf4-a892-413f-982e-d49b22221882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:18.950967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3adf4-a892-413f-982e-d49b22221882 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:18.961530 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3adf4-a892-413f-982e-d49b22221882 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:18.963627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3adf4-a892-413f-982e-d49b22221882 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:18.965372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 667/1322] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:17:18 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:17:18.977968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ce355-3ddf-4a76-98a7-7d472882d1a6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:18.979188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c08ce355-3ddf-4a76-98a7-7d472882d1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:19.070272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ce355-3ddf-4a76-98a7-7d472882d1a6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:19.155983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7a22-310c-4827-af82-e0cc77ac51d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:19.156630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7a22-310c-4827-af82-e0cc77ac51d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:19.156925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7a22-310c-4827-af82-e0cc77ac51d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:19.157193 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7a22-310c-4827-af82-e0cc77ac51d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:19.158862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a2bb7a22-310c-4827-af82-e0cc77ac51d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:19.276609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7a22-310c-4827-af82-e0cc77ac51d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:19.278092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7a22-310c-4827-af82-e0cc77ac51d9 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:19.295950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 656/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:22.029012 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de476c1-41eb-42f2-84d9-4b7366c29e90 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:22.029625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de476c1-41eb-42f2-84d9-4b7366c29e90 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:22.029625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de476c1-41eb-42f2-84d9-4b7366c29e90 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:22.031432 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 668/1324] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:22.038179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9002a1-63fe-43df-ab23-ec3dbc4b4652 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:22.038945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9002a1-63fe-43df-ab23-ec3dbc4b4652 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:22.039068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9002a1-63fe-43df-ab23-ec3dbc4b4652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:22.119810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9d9002a1-63fe-43df-ab23-ec3dbc4b4652 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:22.121021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9d9002a1-63fe-43df-ab23-ec3dbc4b4652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:22.223239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 657/1325] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:22.269132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de476c1-41eb-42f2-84d9-4b7366c29e90 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:22.270691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9de476c1-41eb-42f2-84d9-4b7366c29e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:22.421808 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de476c1-41eb-42f2-84d9-4b7366c29e90 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:22.519877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f075a0e-a2fc-4187-b7a6-ab6bbd864290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:22.520745 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f075a0e-a2fc-4187-b7a6-ab6bbd864290 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:22.521018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f075a0e-a2fc-4187-b7a6-ab6bbd864290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:22.521275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f075a0e-a2fc-4187-b7a6-ab6bbd864290 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:22.531755 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f075a0e-a2fc-4187-b7a6-ab6bbd864290 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:22.533847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f075a0e-a2fc-4187-b7a6-ab6bbd864290 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:22.535870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 669/1326] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:17:22 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:17:22.547236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9002a1-63fe-43df-ab23-ec3dbc4b4652 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:22.548314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9d9002a1-63fe-43df-ab23-ec3dbc4b4652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:22.639876 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9002a1-63fe-43df-ab23-ec3dbc4b4652 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:22.712079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dfd95-b3ba-43fa-bd5a-2bad1876dc56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:22.712733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dfd95-b3ba-43fa-bd5a-2bad1876dc56 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:22.713014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dfd95-b3ba-43fa-bd5a-2bad1876dc56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:22.713327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dfd95-b3ba-43fa-bd5a-2bad1876dc56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:22.714966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5c1dfd95-b3ba-43fa-bd5a-2bad1876dc56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:22.818597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dfd95-b3ba-43fa-bd5a-2bad1876dc56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:22.819984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dfd95-b3ba-43fa-bd5a-2bad1876dc56 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:22.839145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 658/1327] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:17:25.674575 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab3e88-dab2-44da-9698-a7a42264efc0 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:25.675118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab3e88-dab2-44da-9698-a7a42264efc0 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:25.675118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab3e88-dab2-44da-9698-a7a42264efc0 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:25.677050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 670/1328] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:25.682467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea999-970e-451c-af4b-168d8fbfaa12 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:25.682930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea999-970e-451c-af4b-168d8fbfaa12 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:25.683030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ea999-970e-451c-af4b-168d8fbfaa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:25.746329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0f8ea999-970e-451c-af4b-168d8fbfaa12 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:25.747504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0f8ea999-970e-451c-af4b-168d8fbfaa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:25.844141 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 659/1329] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:25.879669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab3e88-dab2-44da-9698-a7a42264efc0 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:25.881335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ebab3e88-dab2-44da-9698-a7a42264efc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:25.984712 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab3e88-dab2-44da-9698-a7a42264efc0 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:26.056515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a94e34-1391-49f1-98d8-adf437d55715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:26.057143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a94e34-1391-49f1-98d8-adf437d55715 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:26.057445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a94e34-1391-49f1-98d8-adf437d55715 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:26.057713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a94e34-1391-49f1-98d8-adf437d55715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:26.059319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-46a94e34-1391-49f1-98d8-adf437d55715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:26.168608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a94e34-1391-49f1-98d8-adf437d55715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:26.170110 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a94e34-1391-49f1-98d8-adf437d55715 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:26.188895 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 671/1330] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:28.437124 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84066b69-2c4f-4bdd-a063-7f1cc95293b1 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:28.437795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84066b69-2c4f-4bdd-a063-7f1cc95293b1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:28.437795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84066b69-2c4f-4bdd-a063-7f1cc95293b1 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:28.439526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 660/1331] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:28.445619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad265ab-d934-4f5f-a25d-ad0b12f4d7ae None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:28.446086 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad265ab-d934-4f5f-a25d-ad0b12f4d7ae None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:28.446193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad265ab-d934-4f5f-a25d-ad0b12f4d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:28.513743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-fad265ab-d934-4f5f-a25d-ad0b12f4d7ae None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:28.514955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-fad265ab-d934-4f5f-a25d-ad0b12f4d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:28.609905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 672/1332] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:28.660949 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8d612-f7ac-4e1a-9546-65e38072f3de None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:28.661378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8d612-f7ac-4e1a-9546-65e38072f3de None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:28.661724 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8d612-f7ac-4e1a-9546-65e38072f3de None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:28.663697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 661/1333] 10.222.0.16 () {54 vars in 964 bytes} [Fri Jan 28 01:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:28.669730 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd90be-3a0d-48aa-a158-002d82a44a63 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:28.670031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd90be-3a0d-48aa-a158-002d82a44a63 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:28.670300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd90be-3a0d-48aa-a158-002d82a44a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:28.747073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-f0cd90be-3a0d-48aa-a158-002d82a44a63 None None] MFA Rules not processed for user `84470027e2824dc3a4b735d086de1300`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:28.748253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f0cd90be-3a0d-48aa-a158-002d82a44a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:28.826418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 673/1334] 10.222.0.16 () {58 vars in 1061 bytes} [Fri Jan 28 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:28.835422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8d612-f7ac-4e1a-9546-65e38072f3de None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:28.836967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-46d8d612-f7ac-4e1a-9546-65e38072f3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:28.940964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8d612-f7ac-4e1a-9546-65e38072f3de None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:29.015760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8d2aa-7db9-452d-a640-e037d3f4efe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:29.016408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8d2aa-7db9-452d-a640-e037d3f4efe3 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:29.016682 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8d2aa-7db9-452d-a640-e037d3f4efe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:29.016950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8d2aa-7db9-452d-a640-e037d3f4efe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:29.018625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f1b8d2aa-7db9-452d-a640-e037d3f4efe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:29.125782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8d2aa-7db9-452d-a640-e037d3f4efe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:29.127253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8d2aa-7db9-452d-a640-e037d3f4efe3 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:29.147024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 662/1335] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:31.677252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63628b9-c5b4-48de-8799-2b3c55a85d34 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:31.677869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63628b9-c5b4-48de-8799-2b3c55a85d34 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:31.677869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63628b9-c5b4-48de-8799-2b3c55a85d34 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:31.679662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 674/1336] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:31.685365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f6cd-ab79-4407-8fcc-839bfb9cc5b5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:31.685815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f6cd-ab79-4407-8fcc-839bfb9cc5b5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:31.685906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8f6cd-ab79-4407-8fcc-839bfb9cc5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:31.752373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4dd8f6cd-ab79-4407-8fcc-839bfb9cc5b5 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:31.753640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4dd8f6cd-ab79-4407-8fcc-839bfb9cc5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:31.849137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 663/1337] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:31.881950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63628b9-c5b4-48de-8799-2b3c55a85d34 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:31.883372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e63628b9-c5b4-48de-8799-2b3c55a85d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:32.014544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63628b9-c5b4-48de-8799-2b3c55a85d34 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:32.111958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967ade-241d-4c34-8626-2beae1842690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:32.112813 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967ade-241d-4c34-8626-2beae1842690 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:32.113089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967ade-241d-4c34-8626-2beae1842690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:32.113390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967ade-241d-4c34-8626-2beae1842690 admin admin] PATH_INFO: `/v3/projects/b5d55db5bd2549ce81113a761b93b5f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:32.124200 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967ade-241d-4c34-8626-2beae1842690 admin admin] RBAC: Authorizing `identity:get_project(project_id=b5d55db5bd2549ce81113a761b93b5f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:32.126592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967ade-241d-4c34-8626-2beae1842690 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:32.128498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 675/1338] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:17:31 2022] GET /identity/v3/projects/b5d55db5bd2549ce81113a761b93b5f7 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:17:32.141671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8f6cd-ab79-4407-8fcc-839bfb9cc5b5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:32.142971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4dd8f6cd-ab79-4407-8fcc-839bfb9cc5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:32.241822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8f6cd-ab79-4407-8fcc-839bfb9cc5b5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:32.319980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52123dfc-71bf-4c84-9acb-04ae287e490c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:32.320646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52123dfc-71bf-4c84-9acb-04ae287e490c service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:32.320922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52123dfc-71bf-4c84-9acb-04ae287e490c service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:32.321190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52123dfc-71bf-4c84-9acb-04ae287e490c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:32.322990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-52123dfc-71bf-4c84-9acb-04ae287e490c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:32.556963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52123dfc-71bf-4c84-9acb-04ae287e490c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:32.558446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52123dfc-71bf-4c84-9acb-04ae287e490c service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:32.576624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 664/1339] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:35.168392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a09517-5408-4c0e-860c-5979f39cf7ea None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:35.168963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a09517-5408-4c0e-860c-5979f39cf7ea None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:35.168963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a09517-5408-4c0e-860c-5979f39cf7ea None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:35.170768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 676/1340] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:35.176175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad21b33-c462-456a-8292-e706522add66 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:35.176612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad21b33-c462-456a-8292-e706522add66 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:35.176712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad21b33-c462-456a-8292-e706522add66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:35.241729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2ad21b33-c462-456a-8292-e706522add66 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:35.242903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2ad21b33-c462-456a-8292-e706522add66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:35.340945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 665/1341] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:35.376868 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a09517-5408-4c0e-860c-5979f39cf7ea None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:35.378413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f2a09517-5408-4c0e-860c-5979f39cf7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:35.483634 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a09517-5408-4c0e-860c-5979f39cf7ea None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:35.556288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0c1e-7c7b-4936-a1b9-b6c2558d696a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:35.556932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0c1e-7c7b-4936-a1b9-b6c2558d696a service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:35.557208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0c1e-7c7b-4936-a1b9-b6c2558d696a service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:35.557506 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0c1e-7c7b-4936-a1b9-b6c2558d696a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:35.559142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-427e0c1e-7c7b-4936-a1b9-b6c2558d696a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:35.670147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e0c1e-7c7b-4936-a1b9-b6c2558d696a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:35.671688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e0c1e-7c7b-4936-a1b9-b6c2558d696a service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:35.692150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 677/1342] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:37.916530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71c13-9098-4278-ba6f-0f9a8ee75ca8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:37.917074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71c13-9098-4278-ba6f-0f9a8ee75ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:37.917074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71c13-9098-4278-ba6f-0f9a8ee75ca8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:37.918875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 666/1343] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:37.924281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b47d-3841-4b96-8de8-59e33577b365 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:37.924713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b47d-3841-4b96-8de8-59e33577b365 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:37.924823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779b47d-3841-4b96-8de8-59e33577b365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:38.001481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e779b47d-3841-4b96-8de8-59e33577b365 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:38.002697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e779b47d-3841-4b96-8de8-59e33577b365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:38.118769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 678/1344] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:38.154243 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71c13-9098-4278-ba6f-0f9a8ee75ca8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:38.178199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71c13-9098-4278-ba6f-0f9a8ee75ca8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:38.183767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7513ea9-69ad-4249-9254-546ee2be973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:38.184630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7513ea9-69ad-4249-9254-546ee2be973e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:38.185002 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7513ea9-69ad-4249-9254-546ee2be973e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:38.185278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7513ea9-69ad-4249-9254-546ee2be973e admin admin] PATH_INFO: `/v3/projects/890dca85d3164528880613bf0afcbf95` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:38.186615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7513ea9-69ad-4249-9254-546ee2be973e admin admin] RBAC: Authorizing `identity:get_project(project_id=890dca85d3164528880613bf0afcbf95)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:38.188394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7513ea9-69ad-4249-9254-546ee2be973e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:38.190153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 667/1345] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:17:38 2022] GET /identity/v3/projects/890dca85d3164528880613bf0afcbf95 => generated 344 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:17:38.202254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779b47d-3841-4b96-8de8-59e33577b365 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:38.204415 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e779b47d-3841-4b96-8de8-59e33577b365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:38.304394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779b47d-3841-4b96-8de8-59e33577b365 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:38.309630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf5770-7f91-4efe-8a39-893b045771e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:38.310602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5770-7f91-4efe-8a39-893b045771e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:38.310954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5770-7f91-4efe-8a39-893b045771e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:38.311299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5770-7f91-4efe-8a39-893b045771e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:38.326127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf5770-7f91-4efe-8a39-893b045771e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:38.328323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf5770-7f91-4efe-8a39-893b045771e8 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:38.340055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 679/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:41.021803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ce11-7fdc-48b8-acc9-0b278cb197b6 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:41.022453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ce11-7fdc-48b8-acc9-0b278cb197b6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:41.022453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ce11-7fdc-48b8-acc9-0b278cb197b6 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:41.024324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 668/1347] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:41.030840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ffc93-5efa-4d51-95d9-1e13faff5c94 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:41.031539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ffc93-5efa-4d51-95d9-1e13faff5c94 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:41.031753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ffc93-5efa-4d51-95d9-1e13faff5c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:41.058612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b22ffc93-5efa-4d51-95d9-1e13faff5c94 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:41.059795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b22ffc93-5efa-4d51-95d9-1e13faff5c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:41.069360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 680/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:41.108511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ce11-7fdc-48b8-acc9-0b278cb197b6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:41.120602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ce11-7fdc-48b8-acc9-0b278cb197b6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:41.124551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c2a6e-31a7-4951-9b05-59327a1935c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:41.125245 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c2a6e-31a7-4951-9b05-59327a1935c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:41.125532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c2a6e-31a7-4951-9b05-59327a1935c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:41.125797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c2a6e-31a7-4951-9b05-59327a1935c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:41.135372 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c2a6e-31a7-4951-9b05-59327a1935c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:41.136878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c2a6e-31a7-4951-9b05-59327a1935c5 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:41.146626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 669/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:45.417783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153522-da97-4bcd-9e37-10a7ecb4ea2e None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:45.418303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153522-da97-4bcd-9e37-10a7ecb4ea2e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:45.418303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153522-da97-4bcd-9e37-10a7ecb4ea2e None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:45.420074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 681/1350] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:45.425954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c8130-940b-4cd9-beac-de3ec7e18a2c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:45.426469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c8130-940b-4cd9-beac-de3ec7e18a2c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:45.426565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c8130-940b-4cd9-beac-de3ec7e18a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:45.446418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-258c8130-940b-4cd9-beac-de3ec7e18a2c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:45.447582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-258c8130-940b-4cd9-beac-de3ec7e18a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:45.456652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 670/1351] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:45.480863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97153522-da97-4bcd-9e37-10a7ecb4ea2e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:45.494423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97153522-da97-4bcd-9e37-10a7ecb4ea2e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:45.499357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd21fc0-66d0-4181-96f0-19c617974bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:45.499999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd21fc0-66d0-4181-96f0-19c617974bbb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:45.500277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd21fc0-66d0-4181-96f0-19c617974bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:45.500520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd21fc0-66d0-4181-96f0-19c617974bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:45.501323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd21fc0-66d0-4181-96f0-19c617974bbb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:45.503183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd21fc0-66d0-4181-96f0-19c617974bbb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:45.517866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 682/1352] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:17:45 2022] GET /identity/v3/projects => generated 2553 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:17:47.762118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b683c-55f8-485f-815c-971405e39ca4 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:47.762676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b683c-55f8-485f-815c-971405e39ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:47.762676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b683c-55f8-485f-815c-971405e39ca4 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:47.764442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 671/1353] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:47.769832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6458b-41cb-4bec-8ff4-ee30c12c34e7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:47.770257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6458b-41cb-4bec-8ff4-ee30c12c34e7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:47.770385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6458b-41cb-4bec-8ff4-ee30c12c34e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:47.789052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-27e6458b-41cb-4bec-8ff4-ee30c12c34e7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:47.790294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-27e6458b-41cb-4bec-8ff4-ee30c12c34e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:47.798568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 683/1354] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:47.832943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b683c-55f8-485f-815c-971405e39ca4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:47.847533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b683c-55f8-485f-815c-971405e39ca4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:47.852816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e389e-d736-49b9-83b0-8edbea6b2ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:47.853689 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e389e-d736-49b9-83b0-8edbea6b2ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:47.853964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e389e-d736-49b9-83b0-8edbea6b2ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:47.854229 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e389e-d736-49b9-83b0-8edbea6b2ab7 admin admin] PATH_INFO: `/v3/projects/890dca85d3164528880613bf0afcbf95` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:47.855448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e389e-d736-49b9-83b0-8edbea6b2ab7 admin admin] RBAC: Authorizing `identity:get_project(project_id=890dca85d3164528880613bf0afcbf95)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:47.857362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e389e-d736-49b9-83b0-8edbea6b2ab7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:47.859020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 672/1355] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:17:47 2022] GET /identity/v3/projects/890dca85d3164528880613bf0afcbf95 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:17:47.870906 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6458b-41cb-4bec-8ff4-ee30c12c34e7 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:47.882627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6458b-41cb-4bec-8ff4-ee30c12c34e7 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:47.887212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cacf7-ce74-48c4-aea5-7aa077f30656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:47.887931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cacf7-ce74-48c4-aea5-7aa077f30656 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:47.888214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cacf7-ce74-48c4-aea5-7aa077f30656 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:47.888491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cacf7-ce74-48c4-aea5-7aa077f30656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:47.899554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cacf7-ce74-48c4-aea5-7aa077f30656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:47.901000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9cacf7-ce74-48c4-aea5-7aa077f30656 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:47.910468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 684/1356] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:50.726059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6e55d-de18-474e-afdc-399c0294bfac None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:50.726610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6e55d-de18-474e-afdc-399c0294bfac None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:50.726610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6e55d-de18-474e-afdc-399c0294bfac None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:50.728565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 673/1357] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:50.733912 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b59e-eb7b-4e09-a86a-99026707ab7d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:50.734349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b59e-eb7b-4e09-a86a-99026707ab7d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:50.734434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38b59e-eb7b-4e09-a86a-99026707ab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:50.753135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-fc38b59e-eb7b-4e09-a86a-99026707ab7d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:50.754397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-fc38b59e-eb7b-4e09-a86a-99026707ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:50.763322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 685/1358] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:50.800969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6e55d-de18-474e-afdc-399c0294bfac None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:50.803192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-82a6e55d-de18-474e-afdc-399c0294bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:50.818151 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6e55d-de18-474e-afdc-399c0294bfac None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:50.822046 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207c187-5b3a-416a-9586-0e47ec1e6bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:50.822646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207c187-5b3a-416a-9586-0e47ec1e6bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:50.822922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207c187-5b3a-416a-9586-0e47ec1e6bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:50.823197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207c187-5b3a-416a-9586-0e47ec1e6bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:50.832521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207c187-5b3a-416a-9586-0e47ec1e6bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:50.834092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207c187-5b3a-416a-9586-0e47ec1e6bf6 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:50.843648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 674/1359] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:17:55.345769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d32c4-2c67-487c-a257-1d43dc55c8f6 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:55.346305 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d32c4-2c67-487c-a257-1d43dc55c8f6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:55.346305 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d32c4-2c67-487c-a257-1d43dc55c8f6 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:55.348119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 686/1360] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:17:55.353804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75919439-26a6-4438-bd07-0656829df843 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:55.354241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75919439-26a6-4438-bd07-0656829df843 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:55.354346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75919439-26a6-4438-bd07-0656829df843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:55.373888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-75919439-26a6-4438-bd07-0656829df843 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:17:55.375104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-75919439-26a6-4438-bd07-0656829df843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:17:55.384207 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 675/1361] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:17:55.423852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d32c4-2c67-487c-a257-1d43dc55c8f6 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:17:55.436234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d32c4-2c67-487c-a257-1d43dc55c8f6 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:17:55.440404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041945f-5e67-4e09-809a-77d3b32632dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:17:55.441055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041945f-5e67-4e09-809a-77d3b32632dc service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:17:55.441364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041945f-5e67-4e09-809a-77d3b32632dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:17:55.441635 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041945f-5e67-4e09-809a-77d3b32632dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:17:55.452327 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041945f-5e67-4e09-809a-77d3b32632dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:17:55.453846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041945f-5e67-4e09-809a-77d3b32632dc service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:17:55.463737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 687/1362] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:00.511066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501f95-ff73-467c-adfd-6037f46046cf None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:00.511971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501f95-ff73-467c-adfd-6037f46046cf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:00.512398 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85501f95-ff73-467c-adfd-6037f46046cf None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:00.514812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 676/1363] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jan 28 01:18:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:00.520368 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f1691-195d-4b5d-98cb-1a4e43440e1b None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:00.520851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f1691-195d-4b5d-98cb-1a4e43440e1b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:00.521055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f1691-195d-4b5d-98cb-1a4e43440e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:00.591111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-364f1691-195d-4b5d-98cb-1a4e43440e1b None None] MFA Rules not processed for user `aac3e041554a4439bfa91520e52fbd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:00.592924 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-364f1691-195d-4b5d-98cb-1a4e43440e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:00.666985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 688/1364] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jan 28 01:18:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:04.665719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b58d8-d842-47f8-84e0-7a736381a22e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:04.666595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b58d8-d842-47f8-84e0-7a736381a22e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:04.666842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b58d8-d842-47f8-84e0-7a736381a22e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:04.668836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 677/1365] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jan 28 01:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:04.674470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9109b-c5f0-49d3-9698-55ee7ac4b880 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:04.674916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9109b-c5f0-49d3-9698-55ee7ac4b880 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:04.675005 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9109b-c5f0-49d3-9698-55ee7ac4b880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:04.696749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-84d9109b-c5f0-49d3-9698-55ee7ac4b880 None None] MFA Rules not processed for user `aac3e041554a4439bfa91520e52fbd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:04.697971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-84d9109b-c5f0-49d3-9698-55ee7ac4b880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:04.707429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 689/1366] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jan 28 01:18:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:06.407128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715ac3-3ec8-4552-b1cb-f944fae15ad5 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:06.407662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715ac3-3ec8-4552-b1cb-f944fae15ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:06.407662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715ac3-3ec8-4552-b1cb-f944fae15ad5 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:06.409641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 678/1367] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jan 28 01:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:06.414721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a36e2-de3a-4e61-89e8-3306105d8fc6 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:06.415124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a36e2-de3a-4e61-89e8-3306105d8fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:06.415440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a36e2-de3a-4e61-89e8-3306105d8fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:06.435450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-5f5a36e2-de3a-4e61-89e8-3306105d8fc6 None None] MFA Rules not processed for user `aac3e041554a4439bfa91520e52fbd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:06.436642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5f5a36e2-de3a-4e61-89e8-3306105d8fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:06.446383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 690/1368] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jan 28 01:18:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:10.135228 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce2fad-1502-4747-ae8b-3aa81829bd6b None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:10.135854 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce2fad-1502-4747-ae8b-3aa81829bd6b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:10.136070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce2fad-1502-4747-ae8b-3aa81829bd6b None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:10.138195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 679/1369] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:10.143287 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e98116-35e3-4e8e-aa8e-9a3cef156493 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:10.144087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e98116-35e3-4e8e-aa8e-9a3cef156493 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:10.144371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e98116-35e3-4e8e-aa8e-9a3cef156493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:10.162939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-38e98116-35e3-4e8e-aa8e-9a3cef156493 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:10.164130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-38e98116-35e3-4e8e-aa8e-9a3cef156493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:10.173101 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 691/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:10.222793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b814f7-d4ee-40f5-8fe7-5dc868428745 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:10.223079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b814f7-d4ee-40f5-8fe7-5dc868428745 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:10.223342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b814f7-d4ee-40f5-8fe7-5dc868428745 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:10.225489 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 680/1371] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jan 28 01:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:10.231342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2e9a1-2875-4f06-a183-8ee7dccf6113 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:10.231644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2e9a1-2875-4f06-a183-8ee7dccf6113 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:10.231923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2e9a1-2875-4f06-a183-8ee7dccf6113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:10.285210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1fc2e9a1-2875-4f06-a183-8ee7dccf6113 None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:10.287586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1fc2e9a1-2875-4f06-a183-8ee7dccf6113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:10.402901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 692/1372] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jan 28 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:10.410671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b814f7-d4ee-40f5-8fe7-5dc868428745 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:10.426122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b814f7-d4ee-40f5-8fe7-5dc868428745 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:10.431913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba6186-9aa5-4845-8796-91857023d15d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:10.432580 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba6186-9aa5-4845-8796-91857023d15d service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:10.432863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba6186-9aa5-4845-8796-91857023d15d service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:10.433138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba6186-9aa5-4845-8796-91857023d15d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:10.441590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba6186-9aa5-4845-8796-91857023d15d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:10.443217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba6186-9aa5-4845-8796-91857023d15d service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:10.452857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 681/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:12.875234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d521f-b63f-4e1c-b051-ca0ccb17ccf6 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:12.876374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d521f-b63f-4e1c-b051-ca0ccb17ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:12.876819 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d521f-b63f-4e1c-b051-ca0ccb17ccf6 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:12.880168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 693/1374] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:12.886390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee43f8-4d7a-4418-8b53-08ab7d70cf8f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:12.886848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee43f8-4d7a-4418-8b53-08ab7d70cf8f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:12.886954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee43f8-4d7a-4418-8b53-08ab7d70cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:12.907650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0dee43f8-4d7a-4418-8b53-08ab7d70cf8f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:12.909812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0dee43f8-4d7a-4418-8b53-08ab7d70cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:12.918543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 682/1375] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:12.964648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d521f-b63f-4e1c-b051-ca0ccb17ccf6 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:12.980897 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d521f-b63f-4e1c-b051-ca0ccb17ccf6 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:12.987266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aca477-a32e-464a-be95-1f1295ce5544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:12.988000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aca477-a32e-464a-be95-1f1295ce5544 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:12.988375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aca477-a32e-464a-be95-1f1295ce5544 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:12.988744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aca477-a32e-464a-be95-1f1295ce5544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:12.997637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aca477-a32e-464a-be95-1f1295ce5544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:12.999350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aca477-a32e-464a-be95-1f1295ce5544 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:13.009264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 694/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:15.638716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907763e-3b22-4646-adff-7f4803618903 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:15.639202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907763e-3b22-4646-adff-7f4803618903 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:15.639202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907763e-3b22-4646-adff-7f4803618903 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:15.641047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 683/1377] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:15.646525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c6b7-30e4-463e-a615-398d6b92b40b None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:15.646977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c6b7-30e4-463e-a615-398d6b92b40b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:15.647051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64c6b7-30e4-463e-a615-398d6b92b40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:15.665151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4a64c6b7-30e4-463e-a615-398d6b92b40b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:15.666363 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4a64c6b7-30e4-463e-a615-398d6b92b40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:15.674753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 695/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:15.720102 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c364c-e14b-4726-809f-5cc27f50270f None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:15.720385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c364c-e14b-4726-809f-5cc27f50270f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:15.720660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c364c-e14b-4726-809f-5cc27f50270f None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:15.722488 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 684/1379] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jan 28 01:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:15.727887 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da25ba9-f031-4646-a312-e2f3ca1303c2 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:15.728144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da25ba9-f031-4646-a312-e2f3ca1303c2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:15.728448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da25ba9-f031-4646-a312-e2f3ca1303c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:15.748073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-8da25ba9-f031-4646-a312-e2f3ca1303c2 None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:15.749270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8da25ba9-f031-4646-a312-e2f3ca1303c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:15.762085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 696/1380] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jan 28 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:15.770850 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c364c-e14b-4726-809f-5cc27f50270f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:15.797175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c364c-e14b-4726-809f-5cc27f50270f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:15.804403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f92867-9e8a-4330-83be-d4b7cda8c949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:15.805045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92867-9e8a-4330-83be-d4b7cda8c949 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:15.805348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92867-9e8a-4330-83be-d4b7cda8c949 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:15.805616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f92867-9e8a-4330-83be-d4b7cda8c949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:15.815041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f92867-9e8a-4330-83be-d4b7cda8c949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:15.816622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f92867-9e8a-4330-83be-d4b7cda8c949 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:15.827408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 685/1381] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:18:18.104414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313292-7fcf-4f43-81d8-78ce51102274 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:18.105031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313292-7fcf-4f43-81d8-78ce51102274 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:18.105031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71313292-7fcf-4f43-81d8-78ce51102274 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:18.106815 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 697/1382] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:18.112934 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ccf55-d33d-44a1-a8f4-ee7e509d2798 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:18.113891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ccf55-d33d-44a1-a8f4-ee7e509d2798 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:18.114419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ccf55-d33d-44a1-a8f4-ee7e509d2798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:18.133827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9c4ccf55-d33d-44a1-a8f4-ee7e509d2798 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:18.135348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9c4ccf55-d33d-44a1-a8f4-ee7e509d2798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:18.144119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 686/1383] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:18.167629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977816e7-181a-4158-aaaa-935256d8ab19 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:18.167887 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977816e7-181a-4158-aaaa-935256d8ab19 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:18.168386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977816e7-181a-4158-aaaa-935256d8ab19 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:18.170190 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 698/1384] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:18.175822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2d12-f8aa-4698-ad84-3a41eef6ecb5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:18.175822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2d12-f8aa-4698-ad84-3a41eef6ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:18.176096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab2d12-f8aa-4698-ad84-3a41eef6ecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:18.188284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977816e7-181a-4158-aaaa-935256d8ab19 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:18.194546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-77ab2d12-f8aa-4698-ad84-3a41eef6ecb5 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:18.195718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-77ab2d12-f8aa-4698-ad84-3a41eef6ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:18.203753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977816e7-181a-4158-aaaa-935256d8ab19 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:18.204540 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 687/1385] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:18.214370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa68c6f-2ebf-4afe-b4f7-5bf04c9ced4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:18.215049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa68c6f-2ebf-4afe-b4f7-5bf04c9ced4a service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:18.215330 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa68c6f-2ebf-4afe-b4f7-5bf04c9ced4a service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:18.215598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa68c6f-2ebf-4afe-b4f7-5bf04c9ced4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:18.225577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa68c6f-2ebf-4afe-b4f7-5bf04c9ced4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:18.227186 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa68c6f-2ebf-4afe-b4f7-5bf04c9ced4a service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:18.238373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 699/1386] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:18.476161 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d3ba1-4c25-485e-8afc-84dc5d70d5d0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:18.476733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d3ba1-4c25-485e-8afc-84dc5d70d5d0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:18.477033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d3ba1-4c25-485e-8afc-84dc5d70d5d0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:18.479204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 688/1387] 10.222.0.16 () {54 vars in 963 bytes} [Fri Jan 28 01:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:18.485655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bc0f1-5c79-436f-a0de-ba247dcdcbc1 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:18.485946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bc0f1-5c79-436f-a0de-ba247dcdcbc1 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:18.486231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bc0f1-5c79-436f-a0de-ba247dcdcbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:18.535143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-cd0bc0f1-5c79-436f-a0de-ba247dcdcbc1 None None] MFA Rules not processed for user `a19c46c2ecd746d7a6e10c09d706a675`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:18.536387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-cd0bc0f1-5c79-436f-a0de-ba247dcdcbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:18.594474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 700/1388] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Jan 28 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:18.601899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d3ba1-4c25-485e-8afc-84dc5d70d5d0 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:18.616198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d3ba1-4c25-485e-8afc-84dc5d70d5d0 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:18.619871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec469f-9155-43e3-9519-9041a93bb905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:18.620941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec469f-9155-43e3-9519-9041a93bb905 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:18.621190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec469f-9155-43e3-9519-9041a93bb905 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:18.621522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec469f-9155-43e3-9519-9041a93bb905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:18.634930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec469f-9155-43e3-9519-9041a93bb905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:18.636385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec469f-9155-43e3-9519-9041a93bb905 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:18.646346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 689/1389] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:20.459532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a31b-9362-452f-9f80-f8cfbf769581 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:20.459985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a31b-9362-452f-9f80-f8cfbf769581 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:20.460074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a31b-9362-452f-9f80-f8cfbf769581 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:20.461977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 701/1390] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:20.467837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bed24e-b0dc-4745-aca4-f493eb95cfa5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:20.468258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bed24e-b0dc-4745-aca4-f493eb95cfa5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:20.468374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bed24e-b0dc-4745-aca4-f493eb95cfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:20.486558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-95bed24e-b0dc-4745-aca4-f493eb95cfa5 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:20.487764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-95bed24e-b0dc-4745-aca4-f493eb95cfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:20.496707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 690/1391] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:20.540990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16a31b-9362-452f-9f80-f8cfbf769581 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:20.555706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16a31b-9362-452f-9f80-f8cfbf769581 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:20.561463 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1153914-32ea-4b73-aeac-d3e1834a288f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:20.562100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153914-32ea-4b73-aeac-d3e1834a288f service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:20.562376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153914-32ea-4b73-aeac-d3e1834a288f service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:20.562647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153914-32ea-4b73-aeac-d3e1834a288f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:20.571322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1153914-32ea-4b73-aeac-d3e1834a288f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:20.572903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1153914-32ea-4b73-aeac-d3e1834a288f service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:20.583558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 702/1392] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:22.834528 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e1e14-e1df-4d6a-9eab-778b822af1a3 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:22.835408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e1e14-e1df-4d6a-9eab-778b822af1a3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:22.835845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e1e14-e1df-4d6a-9eab-778b822af1a3 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:22.843530 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960448e-2da1-4184-9cc4-270e52c6ba14 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:22.844265 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960448e-2da1-4184-9cc4-270e52c6ba14 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:22.844680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960448e-2da1-4184-9cc4-270e52c6ba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:22.846228 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 691/1393] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:22.862944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-f960448e-2da1-4184-9cc4-270e52c6ba14 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:22.864412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f960448e-2da1-4184-9cc4-270e52c6ba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:22.873248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 703/1394] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:22.916842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e1e14-e1df-4d6a-9eab-778b822af1a3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:22.936405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e1e14-e1df-4d6a-9eab-778b822af1a3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:22.947533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08478ca8-81b9-4120-a56b-718a5ec11022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:22.948468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08478ca8-81b9-4120-a56b-718a5ec11022 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:22.948911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08478ca8-81b9-4120-a56b-718a5ec11022 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:22.949407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08478ca8-81b9-4120-a56b-718a5ec11022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:22.959088 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08478ca8-81b9-4120-a56b-718a5ec11022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:22.960870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08478ca8-81b9-4120-a56b-718a5ec11022 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:22.972167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 692/1395] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:25.180000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537508b-756a-43d0-90d4-fedd00bdca1f None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:25.180577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537508b-756a-43d0-90d4-fedd00bdca1f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:25.180577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537508b-756a-43d0-90d4-fedd00bdca1f None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:25.182325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 704/1396] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:25.187770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2897-a001-4d60-8296-b837573e63e2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:25.188242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2897-a001-4d60-8296-b837573e63e2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:25.188320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2897-a001-4d60-8296-b837573e63e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:25.207043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-fc3c2897-a001-4d60-8296-b837573e63e2 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:25.208254 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fc3c2897-a001-4d60-8296-b837573e63e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:25.217089 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 693/1397] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:25.259125 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537508b-756a-43d0-90d4-fedd00bdca1f None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:25.273729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537508b-756a-43d0-90d4-fedd00bdca1f None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:25.280692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b4e3-ca0f-4531-b0a0-a610fcb6e2e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:25.281404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b4e3-ca0f-4531-b0a0-a610fcb6e2e7 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:25.281683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b4e3-ca0f-4531-b0a0-a610fcb6e2e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:25.281954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b4e3-ca0f-4531-b0a0-a610fcb6e2e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:25.291786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b4e3-ca0f-4531-b0a0-a610fcb6e2e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:25.293535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b4e3-ca0f-4531-b0a0-a610fcb6e2e7 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:25.304546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 705/1398] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:27.939030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42579568-1097-419c-bde6-cc7b83de5364 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:27.939624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42579568-1097-419c-bde6-cc7b83de5364 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:27.939624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42579568-1097-419c-bde6-cc7b83de5364 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:27.941492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 694/1399] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:27.948739 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53644024-a1f5-46e7-b272-008ad2c7b01c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:27.949166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53644024-a1f5-46e7-b272-008ad2c7b01c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:27.949402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53644024-a1f5-46e7-b272-008ad2c7b01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:27.968853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-53644024-a1f5-46e7-b272-008ad2c7b01c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:27.970069 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-53644024-a1f5-46e7-b272-008ad2c7b01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:27.979429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 706/1400] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:28.023636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42579568-1097-419c-bde6-cc7b83de5364 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:28.043078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42579568-1097-419c-bde6-cc7b83de5364 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:28.048565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44590891-3f5e-41a1-b137-21369eb4415f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:28.049171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590891-3f5e-41a1-b137-21369eb4415f service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:28.049479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590891-3f5e-41a1-b137-21369eb4415f service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:28.049743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590891-3f5e-41a1-b137-21369eb4415f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:28.058031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44590891-3f5e-41a1-b137-21369eb4415f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:28.059587 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44590891-3f5e-41a1-b137-21369eb4415f service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:28.068730 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 695/1401] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:30.789664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad21f1-a4d5-41fe-a1dc-9d93206199fd None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:30.790569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad21f1-a4d5-41fe-a1dc-9d93206199fd None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:30.790569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad21f1-a4d5-41fe-a1dc-9d93206199fd None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:30.792892 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 707/1402] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:30.800674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dbf0e-8964-44f8-b563-81d83fb7ec48 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:30.801249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dbf0e-8964-44f8-b563-81d83fb7ec48 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:30.801701 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dbf0e-8964-44f8-b563-81d83fb7ec48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:30.827789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-090dbf0e-8964-44f8-b563-81d83fb7ec48 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:30.829552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-090dbf0e-8964-44f8-b563-81d83fb7ec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:30.841440 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 696/1403] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:30.902706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad21f1-a4d5-41fe-a1dc-9d93206199fd None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:30.921741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad21f1-a4d5-41fe-a1dc-9d93206199fd None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:30.929860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e712cee-cadb-4d2c-b896-7a6919a97bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:30.930592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e712cee-cadb-4d2c-b896-7a6919a97bb2 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:30.930877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e712cee-cadb-4d2c-b896-7a6919a97bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:30.931197 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e712cee-cadb-4d2c-b896-7a6919a97bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:30.941564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e712cee-cadb-4d2c-b896-7a6919a97bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:30.943230 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e712cee-cadb-4d2c-b896-7a6919a97bb2 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:30.953466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 708/1404] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:33.285097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109dc9c-9981-4e88-971e-5797f30b0a36 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:33.285746 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109dc9c-9981-4e88-971e-5797f30b0a36 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:33.285746 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109dc9c-9981-4e88-971e-5797f30b0a36 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:33.287513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 697/1405] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:33.293143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65ece-f8aa-40c7-becd-701958f8cbfa None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:33.293620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65ece-f8aa-40c7-becd-701958f8cbfa None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:33.293719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c65ece-f8aa-40c7-becd-701958f8cbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:33.311611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-68c65ece-f8aa-40c7-becd-701958f8cbfa None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:33.312778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-68c65ece-f8aa-40c7-becd-701958f8cbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:33.321010 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 709/1406] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:33.365178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109dc9c-9981-4e88-971e-5797f30b0a36 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:33.381552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109dc9c-9981-4e88-971e-5797f30b0a36 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:33.387813 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935c4f7-1d6a-4295-9e3d-851ff69f8f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:33.388475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935c4f7-1d6a-4295-9e3d-851ff69f8f6d service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:33.388754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935c4f7-1d6a-4295-9e3d-851ff69f8f6d service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:33.389065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935c4f7-1d6a-4295-9e3d-851ff69f8f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:33.398439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935c4f7-1d6a-4295-9e3d-851ff69f8f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:33.400053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935c4f7-1d6a-4295-9e3d-851ff69f8f6d service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:33.410043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 698/1407] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:33.617659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d707f-81ec-45c3-9f37-c8ce2ccea75b None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:33.617881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d707f-81ec-45c3-9f37-c8ce2ccea75b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:33.618098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d707f-81ec-45c3-9f37-c8ce2ccea75b None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:33.619934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 710/1408] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:33.625864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5dfa5-509d-468e-a0a4-76a34b4f4c5f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:33.626434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5dfa5-509d-468e-a0a4-76a34b4f4c5f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:33.626711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5dfa5-509d-468e-a0a4-76a34b4f4c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:33.644933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-55c5dfa5-509d-468e-a0a4-76a34b4f4c5f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:33.646302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-55c5dfa5-509d-468e-a0a4-76a34b4f4c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:33.655258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 699/1409] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:33.710282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816412-a21b-441c-a12d-f3658b4ec494 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:33.710603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816412-a21b-441c-a12d-f3658b4ec494 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:33.710893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a816412-a21b-441c-a12d-f3658b4ec494 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:33.712823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 711/1410] 10.222.0.16 () {54 vars in 962 bytes} [Fri Jan 28 01:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:33.720319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5785d6-cba4-4a1c-9203-cc5d30f13085 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:33.720607 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5785d6-cba4-4a1c-9203-cc5d30f13085 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:33.720890 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5785d6-cba4-4a1c-9203-cc5d30f13085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:33.771362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-eb5785d6-cba4-4a1c-9203-cc5d30f13085 None None] MFA Rules not processed for user `36ec2950259d4ed0925d7a19a6217af2`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:33.772541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-eb5785d6-cba4-4a1c-9203-cc5d30f13085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:33.832222 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 700/1411] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Jan 28 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:33.839973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a816412-a21b-441c-a12d-f3658b4ec494 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:33.851360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a816412-a21b-441c-a12d-f3658b4ec494 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:33.855200 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5d175-9902-4598-a33b-8894ecd8908e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec2950259d4ed0925d7a19a6217af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:33.855824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5d175-9902-4598-a33b-8894ecd8908e service glance] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:33.856097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5d175-9902-4598-a33b-8894ecd8908e service glance] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:33.856363 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5d175-9902-4598-a33b-8894ecd8908e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:33.865653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5d175-9902-4598-a33b-8894ecd8908e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:33.867079 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5d175-9902-4598-a33b-8894ecd8908e service glance] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:33.876478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 712/1412] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:34.288279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb752d-81b2-466c-91ef-f5fd61f306d1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:34.288785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb752d-81b2-466c-91ef-f5fd61f306d1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:34.288925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb752d-81b2-466c-91ef-f5fd61f306d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:34.340295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-02bb752d-81b2-466c-91ef-f5fd61f306d1 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:34.341859 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-02bb752d-81b2-466c-91ef-f5fd61f306d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:34.403938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 701/1413] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:34.445184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373acb0-1972-4dc4-9124-c14c81cacba3 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:34.445697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373acb0-1972-4dc4-9124-c14c81cacba3 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:34.445793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373acb0-1972-4dc4-9124-c14c81cacba3 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:34.447731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 713/1414] 10.222.0.16 () {54 vars in 942 bytes} [Fri Jan 28 01:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:34.454291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa08e4-e068-4dbb-b4d0-76ca2b8feaa6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:34.454579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa08e4-e068-4dbb-b4d0-76ca2b8feaa6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:34.454850 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa08e4-e068-4dbb-b4d0-76ca2b8feaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:34.507608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-12aa08e4-e068-4dbb-b4d0-76ca2b8feaa6 None None] MFA Rules not processed for user `ca65456d336b4c3898831af80e6435a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:34.508928 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-12aa08e4-e068-4dbb-b4d0-76ca2b8feaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:34.583430 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 702/1415] 10.222.0.16 () {58 vars in 1039 bytes} [Fri Jan 28 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:18:34.593369 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373acb0-1972-4dc4-9124-c14c81cacba3 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:34.608305 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373acb0-1972-4dc4-9124-c14c81cacba3 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:34.613483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4fa2c-e44a-4d2f-bbfb-d9951932595e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:34.614321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4fa2c-e44a-4d2f-bbfb-d9951932595e service swift] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:34.614603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4fa2c-e44a-4d2f-bbfb-d9951932595e service swift] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:34.614872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4fa2c-e44a-4d2f-bbfb-d9951932595e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:34.623958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4fa2c-e44a-4d2f-bbfb-d9951932595e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:34.625812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4fa2c-e44a-4d2f-bbfb-d9951932595e service swift] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:34.634164 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 714/1416] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:18:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:18:35.694860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7205e-3fcc-4042-b97d-4bae4e671290 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:35.695419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7205e-3fcc-4042-b97d-4bae4e671290 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:35.695575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7205e-3fcc-4042-b97d-4bae4e671290 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:35.698005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 703/1417] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:35.704030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809a411-f6be-441d-9f64-d53b7e570e47 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:35.704474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809a411-f6be-441d-9f64-d53b7e570e47 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:35.704577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809a411-f6be-441d-9f64-d53b7e570e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:35.722899 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d809a411-f6be-441d-9f64-d53b7e570e47 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:35.724179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d809a411-f6be-441d-9f64-d53b7e570e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:35.732275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 715/1418] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:35.777013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7205e-3fcc-4042-b97d-4bae4e671290 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:35.795022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7205e-3fcc-4042-b97d-4bae4e671290 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:35.800655 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3bd10-c26c-453a-90c3-6f9235180cfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:35.801543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bd10-c26c-453a-90c3-6f9235180cfc service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:35.801926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bd10-c26c-453a-90c3-6f9235180cfc service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:35.802301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bd10-c26c-453a-90c3-6f9235180cfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:35.811343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3bd10-c26c-453a-90c3-6f9235180cfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:35.813014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3bd10-c26c-453a-90c3-6f9235180cfc service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:35.823031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 704/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:38.089644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96da40-f404-4df0-ab48-c7f418d56843 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:38.090269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96da40-f404-4df0-ab48-c7f418d56843 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:38.090269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96da40-f404-4df0-ab48-c7f418d56843 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:38.092314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 716/1420] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:38.097588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f762ca-9c13-4105-bc1c-5828b61b26f3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:38.098435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f762ca-9c13-4105-bc1c-5828b61b26f3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:38.098738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f762ca-9c13-4105-bc1c-5828b61b26f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:38.118729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-04f762ca-9c13-4105-bc1c-5828b61b26f3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:38.119918 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-04f762ca-9c13-4105-bc1c-5828b61b26f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:38.127715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 705/1421] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:18:38.170847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96da40-f404-4df0-ab48-c7f418d56843 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:38.186500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96da40-f404-4df0-ab48-c7f418d56843 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:38.192424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098f6f3-0bf7-4278-b195-3640b486e641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:38.193068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f6f3-0bf7-4278-b195-3640b486e641 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:38.193381 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f6f3-0bf7-4278-b195-3640b486e641 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:38.193657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f6f3-0bf7-4278-b195-3640b486e641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:38.202710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098f6f3-0bf7-4278-b195-3640b486e641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:38.204477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098f6f3-0bf7-4278-b195-3640b486e641 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:38.217359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 717/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:18:56.522828 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38459947-6be7-4944-97cb-abcec3deeae2 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:56.523455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38459947-6be7-4944-97cb-abcec3deeae2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:56.523455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38459947-6be7-4944-97cb-abcec3deeae2 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:56.525198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 706/1423] 10.222.0.16 () {54 vars in 918 bytes} [Fri Jan 28 01:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:56.531030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9961d5c-7f07-48d6-a995-019099d85ed7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:56.531514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9961d5c-7f07-48d6-a995-019099d85ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:56.531618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9961d5c-7f07-48d6-a995-019099d85ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:56.551985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e9961d5c-7f07-48d6-a995-019099d85ed7 None None] MFA Rules not processed for user `aac3e041554a4439bfa91520e52fbd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:56.553241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e9961d5c-7f07-48d6-a995-019099d85ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:56.563645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 718/1424] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Jan 28 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:56.578725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ed0ad-1f42-4b3b-9610-24a119e37474 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:56.579015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ed0ad-1f42-4b3b-9610-24a119e37474 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:56.579292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ed0ad-1f42-4b3b-9610-24a119e37474 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:56.581118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 707/1425] 10.222.0.16 () {54 vars in 918 bytes} [Fri Jan 28 01:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:56.586132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9e74-b7a4-41ab-b5bf-c19e2e9930f7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:56.586423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9e74-b7a4-41ab-b5bf-c19e2e9930f7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:56.586695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d9e74-b7a4-41ab-b5bf-c19e2e9930f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:56.606916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-645d9e74-b7a4-41ab-b5bf-c19e2e9930f7 None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:56.608026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-645d9e74-b7a4-41ab-b5bf-c19e2e9930f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:56.618455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 719/1426] 10.222.0.16 () {58 vars in 1015 bytes} [Fri Jan 28 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:18:59.282242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9218610-dd53-426d-9262-618b373ebfd5 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:59.283116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9218610-dd53-426d-9262-618b373ebfd5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:59.283116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9218610-dd53-426d-9262-618b373ebfd5 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:59.286206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 708/1427] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:18:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:18:59.294698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68fb5-f4cc-4869-a1e7-837fae990a88 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:59.295204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68fb5-f4cc-4869-a1e7-837fae990a88 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:59.295204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d68fb5-f4cc-4869-a1e7-837fae990a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:59.314320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-19d68fb5-f4cc-4869-a1e7-837fae990a88 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:18:59.315499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-19d68fb5-f4cc-4869-a1e7-837fae990a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:18:59.323817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 720/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:18:59.374769 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9218610-dd53-426d-9262-618b373ebfd5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:18:59.392717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9218610-dd53-426d-9262-618b373ebfd5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:18:59.399462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0915b-8358-40fd-b251-e586cef6700f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:18:59.400151 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0915b-8358-40fd-b251-e586cef6700f service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:18:59.400367 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0915b-8358-40fd-b251-e586cef6700f service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:18:59.400673 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0915b-8358-40fd-b251-e586cef6700f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:18:59.410314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0915b-8358-40fd-b251-e586cef6700f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:18:59.411985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0915b-8358-40fd-b251-e586cef6700f service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:18:59.421896 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 709/1429] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:00.783270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924538ee-606c-4f51-8e21-5a312e859dab None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:00.783855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924538ee-606c-4f51-8e21-5a312e859dab None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:00.783855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924538ee-606c-4f51-8e21-5a312e859dab None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:00.785691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 721/1430] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:00.791045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd29e1-8058-4ff2-a235-1d97ce7d5bc8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:00.791483 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd29e1-8058-4ff2-a235-1d97ce7d5bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:00.791584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd29e1-8058-4ff2-a235-1d97ce7d5bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:00.812062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-defd29e1-8058-4ff2-a235-1d97ce7d5bc8 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:00.813453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-defd29e1-8058-4ff2-a235-1d97ce7d5bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:00.827306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 710/1431] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:00.981602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924538ee-606c-4f51-8e21-5a312e859dab None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:00.998312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924538ee-606c-4f51-8e21-5a312e859dab None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:01.007459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130f61-1d07-4171-a3b6-24758e68a7a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:01.008092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130f61-1d07-4171-a3b6-24758e68a7a7 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:01.008373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130f61-1d07-4171-a3b6-24758e68a7a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:01.008638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130f61-1d07-4171-a3b6-24758e68a7a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:01.017540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44130f61-1d07-4171-a3b6-24758e68a7a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:01.019133 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44130f61-1d07-4171-a3b6-24758e68a7a7 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:01.029012 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 722/1432] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:02.339926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31368ab5-cb49-4e1b-be4b-a7723bec16d8 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:02.340884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31368ab5-cb49-4e1b-be4b-a7723bec16d8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:02.340884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31368ab5-cb49-4e1b-be4b-a7723bec16d8 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:02.343969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 711/1433] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:19:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:02.349731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ebbf-225b-4f78-b884-e1f19d9c17ac None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:02.350141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ebbf-225b-4f78-b884-e1f19d9c17ac None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:02.350267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ebbf-225b-4f78-b884-e1f19d9c17ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:02.369525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-5634ebbf-225b-4f78-b884-e1f19d9c17ac None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:02.370760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5634ebbf-225b-4f78-b884-e1f19d9c17ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:02.379803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 723/1434] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:02.531973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31368ab5-cb49-4e1b-be4b-a7723bec16d8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:02.547482 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31368ab5-cb49-4e1b-be4b-a7723bec16d8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:02.553363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe66ab7-546e-4299-a2a4-11b60b4426cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:02.553983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe66ab7-546e-4299-a2a4-11b60b4426cc service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:02.554255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe66ab7-546e-4299-a2a4-11b60b4426cc service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:02.554530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe66ab7-546e-4299-a2a4-11b60b4426cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:02.562603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe66ab7-546e-4299-a2a4-11b60b4426cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:02.564176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe66ab7-546e-4299-a2a4-11b60b4426cc service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:02.573612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 712/1435] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:03.868991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30eaf0-6365-4fbd-bf0e-f711d4763317 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:03.870212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30eaf0-6365-4fbd-bf0e-f711d4763317 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:03.870212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30eaf0-6365-4fbd-bf0e-f711d4763317 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:03.873554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 724/1436] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:19:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:03.881242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8372003-4db1-4683-aa9a-4304ff807674 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:03.881646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8372003-4db1-4683-aa9a-4304ff807674 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:03.881755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8372003-4db1-4683-aa9a-4304ff807674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:03.901450 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a8372003-4db1-4683-aa9a-4304ff807674 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:03.902641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a8372003-4db1-4683-aa9a-4304ff807674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:03.911883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 713/1437] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:04.067028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30eaf0-6365-4fbd-bf0e-f711d4763317 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:04.084961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30eaf0-6365-4fbd-bf0e-f711d4763317 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:04.091970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b1742-cad0-4ad7-a7b9-8b1c68f1f026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:04.092659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b1742-cad0-4ad7-a7b9-8b1c68f1f026 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:04.092938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b1742-cad0-4ad7-a7b9-8b1c68f1f026 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:04.093211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b1742-cad0-4ad7-a7b9-8b1c68f1f026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:04.101616 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b1742-cad0-4ad7-a7b9-8b1c68f1f026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:04.103203 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b1742-cad0-4ad7-a7b9-8b1c68f1f026 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:04.112632 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 725/1438] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:05.412942 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82722c8-2979-4d39-a1e8-20c6cf5e7ba2 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:05.413605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82722c8-2979-4d39-a1e8-20c6cf5e7ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:05.413605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82722c8-2979-4d39-a1e8-20c6cf5e7ba2 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:05.415284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 714/1439] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:05.421085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82ae0-f955-43e9-95f9-ced88e3dd1ed None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:05.421790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82ae0-f955-43e9-95f9-ced88e3dd1ed None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:05.421933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a82ae0-f955-43e9-95f9-ced88e3dd1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:05.445082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-82a82ae0-f955-43e9-95f9-ced88e3dd1ed None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:05.446359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-82a82ae0-f955-43e9-95f9-ced88e3dd1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:05.455707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 726/1440] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:05.607115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82722c8-2979-4d39-a1e8-20c6cf5e7ba2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:05.623962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82722c8-2979-4d39-a1e8-20c6cf5e7ba2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:05.630253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad3b8-57e5-4bae-9262-ba0e8f9f1113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:05.630880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad3b8-57e5-4bae-9262-ba0e8f9f1113 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:05.631158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad3b8-57e5-4bae-9262-ba0e8f9f1113 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:05.631429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad3b8-57e5-4bae-9262-ba0e8f9f1113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:05.639824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad3b8-57e5-4bae-9262-ba0e8f9f1113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:05.641443 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad3b8-57e5-4bae-9262-ba0e8f9f1113 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:05.650689 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 715/1441] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:06.901584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a647f6-aef6-47cd-b606-3860a2446bb5 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:06.902365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a647f6-aef6-47cd-b606-3860a2446bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:06.902365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a647f6-aef6-47cd-b606-3860a2446bb5 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:06.905097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 727/1442] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:19:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:06.913039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be371f-6f1b-4c37-935d-1d6314a651a2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:06.913503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be371f-6f1b-4c37-935d-1d6314a651a2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:06.913640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be371f-6f1b-4c37-935d-1d6314a651a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:06.934292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c0be371f-6f1b-4c37-935d-1d6314a651a2 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:06.935510 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c0be371f-6f1b-4c37-935d-1d6314a651a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:06.943608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 716/1443] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:07.098380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a647f6-aef6-47cd-b606-3860a2446bb5 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:07.113123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a647f6-aef6-47cd-b606-3860a2446bb5 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:07.119297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ca90-db6b-4ed3-9a90-cc1791b8ff3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:07.119977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ca90-db6b-4ed3-9a90-cc1791b8ff3b service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:07.120255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ca90-db6b-4ed3-9a90-cc1791b8ff3b service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:07.120522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ca90-db6b-4ed3-9a90-cc1791b8ff3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:07.129395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4ca90-db6b-4ed3-9a90-cc1791b8ff3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:07.131028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4ca90-db6b-4ed3-9a90-cc1791b8ff3b service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:07.140329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 728/1444] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:08.397788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25c133-4d17-4ca2-8f74-3385d2ee489e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:08.398267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25c133-4d17-4ca2-8f74-3385d2ee489e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:08.398267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25c133-4d17-4ca2-8f74-3385d2ee489e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:08.400120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 717/1445] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:08.405176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe16f-6c73-49a3-a64d-c42f5e3b25ee None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:08.405638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe16f-6c73-49a3-a64d-c42f5e3b25ee None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:08.405749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe16f-6c73-49a3-a64d-c42f5e3b25ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:08.425591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-8effe16f-6c73-49a3-a64d-c42f5e3b25ee None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:08.426820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8effe16f-6c73-49a3-a64d-c42f5e3b25ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:08.435386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 729/1446] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:08.599640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25c133-4d17-4ca2-8f74-3385d2ee489e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:08.626255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25c133-4d17-4ca2-8f74-3385d2ee489e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:08.634513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb297c-17a7-4974-9c4c-8cb221dd0341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:08.635156 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb297c-17a7-4974-9c4c-8cb221dd0341 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:08.635461 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb297c-17a7-4974-9c4c-8cb221dd0341 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:08.635731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb297c-17a7-4974-9c4c-8cb221dd0341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:08.644307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb297c-17a7-4974-9c4c-8cb221dd0341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:08.645950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb297c-17a7-4974-9c4c-8cb221dd0341 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:08.655681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 718/1447] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:09.894319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823da6a-0f96-418c-a001-7526bcb21831 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:09.895154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823da6a-0f96-418c-a001-7526bcb21831 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:09.895154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823da6a-0f96-418c-a001-7526bcb21831 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:09.897914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 730/1448] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:19:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:09.905554 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8fad-11e7-498f-aaa7-bed3215d2e50 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:09.905990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8fad-11e7-498f-aaa7-bed3215d2e50 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:09.906081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc8fad-11e7-498f-aaa7-bed3215d2e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:09.924668 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e3dc8fad-11e7-498f-aaa7-bed3215d2e50 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:09.925866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e3dc8fad-11e7-498f-aaa7-bed3215d2e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:09.934464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 719/1449] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:19:10.087333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823da6a-0f96-418c-a001-7526bcb21831 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:10.103793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823da6a-0f96-418c-a001-7526bcb21831 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:10.113291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ff672-4b16-46c9-9ded-7ea07c849447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:10.114269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff672-4b16-46c9-9ded-7ea07c849447 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:10.114627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff672-4b16-46c9-9ded-7ea07c849447 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:10.114989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff672-4b16-46c9-9ded-7ea07c849447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:10.128227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ff672-4b16-46c9-9ded-7ea07c849447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:10.130490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ff672-4b16-46c9-9ded-7ea07c849447 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:10.140170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 731/1450] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:19:11.382741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb779cac-2b86-4616-89a7-38e015eb8b50 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:11.383691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb779cac-2b86-4616-89a7-38e015eb8b50 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:11.383691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb779cac-2b86-4616-89a7-38e015eb8b50 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:11.386545 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 720/1451] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:19:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:19:11.391818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86956-6576-4417-b2f7-9b60fc611c22 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:11.392279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86956-6576-4417-b2f7-9b60fc611c22 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:11.392365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86956-6576-4417-b2f7-9b60fc611c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:11.412481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-09a86956-6576-4417-b2f7-9b60fc611c22 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:11.413704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-09a86956-6576-4417-b2f7-9b60fc611c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:11.421947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 732/1452] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:11.578711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb779cac-2b86-4616-89a7-38e015eb8b50 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:11.603046 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb779cac-2b86-4616-89a7-38e015eb8b50 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:11.610173 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cee20c-f8c2-436d-84da-5106348d0593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:11.610809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee20c-f8c2-436d-84da-5106348d0593 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:11.611086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee20c-f8c2-436d-84da-5106348d0593 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:11.611356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cee20c-f8c2-436d-84da-5106348d0593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:11.622982 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cee20c-f8c2-436d-84da-5106348d0593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:11.624615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cee20c-f8c2-436d-84da-5106348d0593 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:11.634857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 721/1453] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:13.711377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47898-148f-490a-a007-0e87d71a8a45 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:13.712255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47898-148f-490a-a007-0e87d71a8a45 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:13.712255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47898-148f-490a-a007-0e87d71a8a45 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:13.715227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 733/1454] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:19:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:13.724395 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432b02-9e23-4239-899a-7e6eee48dacd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:13.724810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432b02-9e23-4239-899a-7e6eee48dacd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:13.724932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432b02-9e23-4239-899a-7e6eee48dacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:13.743666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f9432b02-9e23-4239-899a-7e6eee48dacd None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:13.744859 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f9432b02-9e23-4239-899a-7e6eee48dacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:13.753934 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 722/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:13.796635 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47898-148f-490a-a007-0e87d71a8a45 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:13.816297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47898-148f-490a-a007-0e87d71a8a45 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:13.821189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d81cff-254b-4ff7-874f-f6a672400269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:13.821860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d81cff-254b-4ff7-874f-f6a672400269 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:13.822144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d81cff-254b-4ff7-874f-f6a672400269 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:13.822411 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d81cff-254b-4ff7-874f-f6a672400269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:13.832116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d81cff-254b-4ff7-874f-f6a672400269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:13.833647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d81cff-254b-4ff7-874f-f6a672400269 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:13.843814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 734/1456] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:16.211407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c986b54-addf-4b29-aec8-0d72bbe2dab1 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:16.212017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c986b54-addf-4b29-aec8-0d72bbe2dab1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:16.212017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c986b54-addf-4b29-aec8-0d72bbe2dab1 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:16.213778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 723/1457] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:16.219592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb019-fa14-481b-92bd-86806fd5c1a6 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:16.220034 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb019-fa14-481b-92bd-86806fd5c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:16.220149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fb019-fa14-481b-92bd-86806fd5c1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:16.238494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-2c1fb019-fa14-481b-92bd-86806fd5c1a6 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:16.239760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-2c1fb019-fa14-481b-92bd-86806fd5c1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:16.248081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 735/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:16.288654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c986b54-addf-4b29-aec8-0d72bbe2dab1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:16.300837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c986b54-addf-4b29-aec8-0d72bbe2dab1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:16.304800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ffecf-8433-433b-bb1b-206eb62839ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:16.305481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ffecf-8433-433b-bb1b-206eb62839ee service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:16.305760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ffecf-8433-433b-bb1b-206eb62839ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:16.306028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ffecf-8433-433b-bb1b-206eb62839ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:16.315407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ffecf-8433-433b-bb1b-206eb62839ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:16.316829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ffecf-8433-433b-bb1b-206eb62839ee service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:16.326069 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 724/1459] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:18.881020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171282-8aeb-4aff-a4d0-966139d11406 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:18.881695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171282-8aeb-4aff-a4d0-966139d11406 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:18.881695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171282-8aeb-4aff-a4d0-966139d11406 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:18.883318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 736/1460] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:18.888845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3476f-c392-48f6-8ecf-7558cba19e69 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:18.889337 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3476f-c392-48f6-8ecf-7558cba19e69 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:18.889444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3476f-c392-48f6-8ecf-7558cba19e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:18.914423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-15e3476f-c392-48f6-8ecf-7558cba19e69 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:18.915602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-15e3476f-c392-48f6-8ecf-7558cba19e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:18.925848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 725/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:18.964619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74171282-8aeb-4aff-a4d0-966139d11406 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:18.976467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74171282-8aeb-4aff-a4d0-966139d11406 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:18.980152 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537e73d-e91a-40ce-b28f-fb305d615be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:18.980790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537e73d-e91a-40ce-b28f-fb305d615be8 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:18.981072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537e73d-e91a-40ce-b28f-fb305d615be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:18.981377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537e73d-e91a-40ce-b28f-fb305d615be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:18.994239 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537e73d-e91a-40ce-b28f-fb305d615be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:18.995688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537e73d-e91a-40ce-b28f-fb305d615be8 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:19.009424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 737/1462] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:21.317873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace0cd-6f65-497a-a473-d73bc4072622 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:21.318486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace0cd-6f65-497a-a473-d73bc4072622 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:21.318486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ace0cd-6f65-497a-a473-d73bc4072622 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:21.320196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 726/1463] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:21.325793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a15f5d-4e19-44ba-86a2-8bca48c81eb9 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:21.326250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a15f5d-4e19-44ba-86a2-8bca48c81eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:21.326348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a15f5d-4e19-44ba-86a2-8bca48c81eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:21.345865 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e6a15f5d-4e19-44ba-86a2-8bca48c81eb9 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:21.347043 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e6a15f5d-4e19-44ba-86a2-8bca48c81eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:21.355548 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 738/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:21.394344 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ace0cd-6f65-497a-a473-d73bc4072622 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:21.407366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ace0cd-6f65-497a-a473-d73bc4072622 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:21.411200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919a8df-5a68-47d3-897b-ffa16e24e685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:21.411824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a8df-5a68-47d3-897b-ffa16e24e685 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:21.412103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a8df-5a68-47d3-897b-ffa16e24e685 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:21.412374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a8df-5a68-47d3-897b-ffa16e24e685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:21.421150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919a8df-5a68-47d3-897b-ffa16e24e685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:21.422606 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919a8df-5a68-47d3-897b-ffa16e24e685 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:21.431774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 727/1465] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:23.722031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4b70-fc2b-40ca-824d-e49122d68a16 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:23.723010 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4b70-fc2b-40ca-824d-e49122d68a16 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:23.723010 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4b70-fc2b-40ca-824d-e49122d68a16 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:23.725020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 739/1466] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:19:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:23.730620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa376bd-ed42-449c-8fbe-52931ebc282a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:23.731078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa376bd-ed42-449c-8fbe-52931ebc282a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:23.731186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa376bd-ed42-449c-8fbe-52931ebc282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:23.749819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-aaa376bd-ed42-449c-8fbe-52931ebc282a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:23.751043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-aaa376bd-ed42-449c-8fbe-52931ebc282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:23.759233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 728/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:23.799856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba4b70-fc2b-40ca-824d-e49122d68a16 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:23.812832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba4b70-fc2b-40ca-824d-e49122d68a16 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:23.817922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c18e3b-891f-412b-ab09-4e40bfefffb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:23.818554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c18e3b-891f-412b-ab09-4e40bfefffb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:23.818828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c18e3b-891f-412b-ab09-4e40bfefffb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:23.819091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c18e3b-891f-412b-ab09-4e40bfefffb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:23.828572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c18e3b-891f-412b-ab09-4e40bfefffb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:23.830029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c18e3b-891f-412b-ab09-4e40bfefffb9 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:23.839533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 740/1468] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:26.083897 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593feaa-ab15-488d-be7f-f0ab2840f2d0 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:26.084510 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593feaa-ab15-488d-be7f-f0ab2840f2d0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:26.084510 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593feaa-ab15-488d-be7f-f0ab2840f2d0 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:26.086255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 729/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:26.093077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294aa65-5e82-486f-aad1-26a4ac15696f None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:26.093540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294aa65-5e82-486f-aad1-26a4ac15696f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:26.093639 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294aa65-5e82-486f-aad1-26a4ac15696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:26.114015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-c294aa65-5e82-486f-aad1-26a4ac15696f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:26.115194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c294aa65-5e82-486f-aad1-26a4ac15696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:26.123376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 741/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:26.162660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593feaa-ab15-488d-be7f-f0ab2840f2d0 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:26.176716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593feaa-ab15-488d-be7f-f0ab2840f2d0 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:26.181078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe06d8-39dd-474b-a869-b61bb357b07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:26.181742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe06d8-39dd-474b-a869-b61bb357b07b service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:26.182023 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe06d8-39dd-474b-a869-b61bb357b07b service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:26.182292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe06d8-39dd-474b-a869-b61bb357b07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:26.192608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe06d8-39dd-474b-a869-b61bb357b07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:26.194072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe06d8-39dd-474b-a869-b61bb357b07b service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:26.203383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 730/1471] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:28.466444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547c2ee-81e6-45c3-8e5c-49c3242365a9 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:28.467044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547c2ee-81e6-45c3-8e5c-49c3242365a9 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:28.467044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547c2ee-81e6-45c3-8e5c-49c3242365a9 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:28.468810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 742/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:28.475261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0aa4f-0c5c-487a-ae20-62f0288eec04 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:28.475985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0aa4f-0c5c-487a-ae20-62f0288eec04 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:28.476099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0aa4f-0c5c-487a-ae20-62f0288eec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:28.495794 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2cf0aa4f-0c5c-487a-ae20-62f0288eec04 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:28.496963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2cf0aa4f-0c5c-487a-ae20-62f0288eec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:28.505696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 731/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:28.546488 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547c2ee-81e6-45c3-8e5c-49c3242365a9 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:28.560646 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547c2ee-81e6-45c3-8e5c-49c3242365a9 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:28.565033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0024395-9c73-400a-a8c0-e8a70e19802b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:28.565700 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0024395-9c73-400a-a8c0-e8a70e19802b service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:28.565995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0024395-9c73-400a-a8c0-e8a70e19802b service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:28.566274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0024395-9c73-400a-a8c0-e8a70e19802b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:28.575771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0024395-9c73-400a-a8c0-e8a70e19802b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:28.577245 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0024395-9c73-400a-a8c0-e8a70e19802b service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:28.586716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 743/1474] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:30.858444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603914e9-c21c-4981-9ec5-9d276f8863aa None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:30.859347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603914e9-c21c-4981-9ec5-9d276f8863aa None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:30.859347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603914e9-c21c-4981-9ec5-9d276f8863aa None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:30.862324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 732/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:19:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:30.867883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5f6bf-f05d-4d31-83c0-673a4fa85bdb None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:30.868314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5f6bf-f05d-4d31-83c0-673a4fa85bdb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:30.868426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5f6bf-f05d-4d31-83c0-673a4fa85bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:30.887687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-c9d5f6bf-f05d-4d31-83c0-673a4fa85bdb None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:30.888781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c9d5f6bf-f05d-4d31-83c0-673a4fa85bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:30.897104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 744/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:30.936425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603914e9-c21c-4981-9ec5-9d276f8863aa None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:30.950167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603914e9-c21c-4981-9ec5-9d276f8863aa None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:30.954299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24c300-c4bc-4e2c-a812-c0afe9422116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:30.954935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c300-c4bc-4e2c-a812-c0afe9422116 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:30.955215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c300-c4bc-4e2c-a812-c0afe9422116 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:30.955484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c300-c4bc-4e2c-a812-c0afe9422116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:30.964350 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24c300-c4bc-4e2c-a812-c0afe9422116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:30.966218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24c300-c4bc-4e2c-a812-c0afe9422116 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:30.975562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 733/1477] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:33.155501 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc597-fa00-47b9-88a9-c4f54044af4a None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:33.156123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc597-fa00-47b9-88a9-c4f54044af4a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:33.156123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc597-fa00-47b9-88a9-c4f54044af4a None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:33.157825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 745/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:19:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:33.165461 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa3754-6233-486c-9a0b-f98c82e120ff None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:33.166187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa3754-6233-486c-9a0b-f98c82e120ff None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:33.166481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa3754-6233-486c-9a0b-f98c82e120ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:33.192611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-63aa3754-6233-486c-9a0b-f98c82e120ff None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:33.193871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-63aa3754-6233-486c-9a0b-f98c82e120ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:33.202566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 734/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:19:33.240391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc597-fa00-47b9-88a9-c4f54044af4a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:33.253767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc597-fa00-47b9-88a9-c4f54044af4a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:33.258229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4117c3f-bc43-4b37-b5dc-d87d51409b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:33.258857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4117c3f-bc43-4b37-b5dc-d87d51409b6c service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:33.259135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4117c3f-bc43-4b37-b5dc-d87d51409b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:33.259405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4117c3f-bc43-4b37-b5dc-d87d51409b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:33.268760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4117c3f-bc43-4b37-b5dc-d87d51409b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:33.270319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4117c3f-bc43-4b37-b5dc-d87d51409b6c service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:33.279967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 746/1480] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:35.496313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ffb0-6179-4315-9c1a-e2b456e850fd None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:35.497181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ffb0-6179-4315-9c1a-e2b456e850fd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:35.497181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ffb0-6179-4315-9c1a-e2b456e850fd None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:35.500079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 735/1481] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:19:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:35.506595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eb5bd-9ad2-47e3-801f-76539659fd6f None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:35.507076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eb5bd-9ad2-47e3-801f-76539659fd6f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:35.507211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eb5bd-9ad2-47e3-801f-76539659fd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:35.536804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-856eb5bd-9ad2-47e3-801f-76539659fd6f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:35.538025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-856eb5bd-9ad2-47e3-801f-76539659fd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:35.546853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 747/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:35.591698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246ffb0-6179-4315-9c1a-e2b456e850fd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:35.604455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246ffb0-6179-4315-9c1a-e2b456e850fd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:35.609927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890d857-9b00-48fd-a0ed-a54bd447df65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:35.610819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890d857-9b00-48fd-a0ed-a54bd447df65 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:35.611153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890d857-9b00-48fd-a0ed-a54bd447df65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:35.611517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890d857-9b00-48fd-a0ed-a54bd447df65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:35.622163 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890d857-9b00-48fd-a0ed-a54bd447df65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:35.623619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890d857-9b00-48fd-a0ed-a54bd447df65 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:35.633910 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 736/1483] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:19:52.237935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0253244-045b-45dd-999a-4bd3b6567634 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:52.238673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0253244-045b-45dd-999a-4bd3b6567634 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:52.238673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0253244-045b-45dd-999a-4bd3b6567634 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:52.240364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 748/1484] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:52.246454 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d6a0-23aa-448d-93ab-afb6c5dde494 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:52.247021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d6a0-23aa-448d-93ab-afb6c5dde494 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:52.247126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2d6a0-23aa-448d-93ab-afb6c5dde494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:52.267942 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-edd2d6a0-23aa-448d-93ab-afb6c5dde494 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:52.269119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-edd2d6a0-23aa-448d-93ab-afb6c5dde494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:52.278385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 737/1485] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:52.325885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5285d-82c3-4b94-85a4-5e32d5677bf9 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:52.326213 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5285d-82c3-4b94-85a4-5e32d5677bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:52.326621 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5285d-82c3-4b94-85a4-5e32d5677bf9 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:52.329978 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 749/1486] 10.222.0.16 () {54 vars in 962 bytes} [Fri Jan 28 01:19:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:52.334810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b18cdb-1837-4372-ac88-5397f3d0c7f2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:52.335165 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b18cdb-1837-4372-ac88-5397f3d0c7f2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:52.335438 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b18cdb-1837-4372-ac88-5397f3d0c7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:52.354831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-06b18cdb-1837-4372-ac88-5397f3d0c7f2 None None] MFA Rules not processed for user `36ec2950259d4ed0925d7a19a6217af2`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:52.356026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-06b18cdb-1837-4372-ac88-5397f3d0c7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:52.363115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 738/1487] 10.222.0.16 () {58 vars in 1059 bytes} [Fri Jan 28 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:19:52.370380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5285d-82c3-4b94-85a4-5e32d5677bf9 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:52.381778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5285d-82c3-4b94-85a4-5e32d5677bf9 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:52.385793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872c76e-f956-473a-98c1-2c9a2520ce8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec2950259d4ed0925d7a19a6217af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:52.386690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872c76e-f956-473a-98c1-2c9a2520ce8f service glance] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:52.386973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872c76e-f956-473a-98c1-2c9a2520ce8f service glance] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:52.387251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872c76e-f956-473a-98c1-2c9a2520ce8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:52.396706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872c76e-f956-473a-98c1-2c9a2520ce8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:52.398176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872c76e-f956-473a-98c1-2c9a2520ce8f service glance] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:52.407541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 750/1488] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:54.656761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2a96-0a17-4934-b2b8-33b35d765ba1 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:54.657317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2a96-0a17-4934-b2b8-33b35d765ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:54.657317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a2a96-0a17-4934-b2b8-33b35d765ba1 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:54.660034 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 739/1489] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:19:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:54.667456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b7632-3bb3-4635-8af6-cfa46a725df4 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:54.667877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b7632-3bb3-4635-8af6-cfa46a725df4 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:54.667983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b7632-3bb3-4635-8af6-cfa46a725df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:54.687402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e54b7632-3bb3-4635-8af6-cfa46a725df4 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:54.688586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e54b7632-3bb3-4635-8af6-cfa46a725df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:54.696809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 751/1490] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:19:54.721589 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2a96-0a17-4934-b2b8-33b35d765ba1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:54.736153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a2a96-0a17-4934-b2b8-33b35d765ba1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:54.741186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a05116-b88a-492c-a2fd-d424e7eeb88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:54.741826 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05116-b88a-492c-a2fd-d424e7eeb88e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:54.742103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05116-b88a-492c-a2fd-d424e7eeb88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:54.742378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05116-b88a-492c-a2fd-d424e7eeb88e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:54.743115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a05116-b88a-492c-a2fd-d424e7eeb88e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:54.744982 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a05116-b88a-492c-a2fd-d424e7eeb88e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:54.759678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 740/1491] 10.222.0.16 () {56 vars in 1108 bytes} [Fri Jan 28 01:19:54 2022] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:19:56.980251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3959af-0336-4051-87c3-4f439242e235 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:56.981203 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3959af-0336-4051-87c3-4f439242e235 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:56.981203 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3959af-0336-4051-87c3-4f439242e235 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:56.984077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 752/1492] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:19:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:56.991463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df6d3-c0cc-4e0c-977e-888b3d8eae36 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:56.991932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df6d3-c0cc-4e0c-977e-888b3d8eae36 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:56.992034 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df6d3-c0cc-4e0c-977e-888b3d8eae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:57.012133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-920df6d3-c0cc-4e0c-977e-888b3d8eae36 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:57.013384 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-920df6d3-c0cc-4e0c-977e-888b3d8eae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:57.024742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 741/1493] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:57.077595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3959af-0336-4051-87c3-4f439242e235 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:57.093069 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3959af-0336-4051-87c3-4f439242e235 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:57.099456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273cdd2-07ce-4d37-8a72-d3717228d0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:57.100079 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273cdd2-07ce-4d37-8a72-d3717228d0c0 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:57.100349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273cdd2-07ce-4d37-8a72-d3717228d0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:57.100628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273cdd2-07ce-4d37-8a72-d3717228d0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:57.108900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273cdd2-07ce-4d37-8a72-d3717228d0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:57.110530 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273cdd2-07ce-4d37-8a72-d3717228d0c0 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:57.119801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 753/1494] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:59.575846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c38058-a7f3-48c9-8b8a-7c79e3c44471 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:59.576717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c38058-a7f3-48c9-8b8a-7c79e3c44471 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:59.576717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c38058-a7f3-48c9-8b8a-7c79e3c44471 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:59.579603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 742/1495] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:19:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:19:59.585836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6934948-0f69-4f82-b0eb-8d270ed62b25 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:59.586326 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6934948-0f69-4f82-b0eb-8d270ed62b25 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:59.586429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6934948-0f69-4f82-b0eb-8d270ed62b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:59.609667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b6934948-0f69-4f82-b0eb-8d270ed62b25 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:19:59.610863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b6934948-0f69-4f82-b0eb-8d270ed62b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:19:59.620269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 754/1496] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:19:59.656675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c38058-a7f3-48c9-8b8a-7c79e3c44471 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:19:59.668105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c38058-a7f3-48c9-8b8a-7c79e3c44471 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:19:59.672343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3b3f1-9916-4f4d-8c48-355f38dbb62d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:19:59.672974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3b3f1-9916-4f4d-8c48-355f38dbb62d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:19:59.673251 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3b3f1-9916-4f4d-8c48-355f38dbb62d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:19:59.673546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3b3f1-9916-4f4d-8c48-355f38dbb62d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:19:59.683332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3b3f1-9916-4f4d-8c48-355f38dbb62d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:19:59.684817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3b3f1-9916-4f4d-8c48-355f38dbb62d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:19:59.694505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 743/1497] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:20:01.910904 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efb0db-a5e5-40fe-a57b-2e9db91111b8 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:01.911479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efb0db-a5e5-40fe-a57b-2e9db91111b8 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:01.911479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efb0db-a5e5-40fe-a57b-2e9db91111b8 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:01.913253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 755/1498] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:20:01.919447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc5ef4-abd2-4443-9fc8-ef0564e28498 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:01.920195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc5ef4-abd2-4443-9fc8-ef0564e28498 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:01.920346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc5ef4-abd2-4443-9fc8-ef0564e28498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:01.945677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-bcbc5ef4-abd2-4443-9fc8-ef0564e28498 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:20:01.946882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bcbc5ef4-abd2-4443-9fc8-ef0564e28498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:20:01.955709 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 744/1499] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:20:02.003362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efb0db-a5e5-40fe-a57b-2e9db91111b8 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:20:02.021482 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efb0db-a5e5-40fe-a57b-2e9db91111b8 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:20:02.026078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c11894-c1de-4091-a68a-067d51362af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:20:02.026707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11894-c1de-4091-a68a-067d51362af0 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:02.026984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11894-c1de-4091-a68a-067d51362af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:02.027244 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11894-c1de-4091-a68a-067d51362af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:02.036692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c11894-c1de-4091-a68a-067d51362af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:20:02.038158 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c11894-c1de-4091-a68a-067d51362af0 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:20:02.047772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 756/1500] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:20:04.415719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff0024-37c9-490c-a42d-b57f9a0346e5 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:04.416221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff0024-37c9-490c-a42d-b57f9a0346e5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:04.416221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff0024-37c9-490c-a42d-b57f9a0346e5 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:04.418100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 745/1501] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:20:04.423405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4626ea-14d4-435a-aa53-be133481849a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:04.423830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4626ea-14d4-435a-aa53-be133481849a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:04.423919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4626ea-14d4-435a-aa53-be133481849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:04.452764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9a4626ea-14d4-435a-aa53-be133481849a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:20:04.454795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9a4626ea-14d4-435a-aa53-be133481849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:20:04.468166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 757/1502] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:20:04.504870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff0024-37c9-490c-a42d-b57f9a0346e5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:20:04.521644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff0024-37c9-490c-a42d-b57f9a0346e5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:20:04.527784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b470e5-0ca0-4892-ae3e-f8622dfc2838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:20:04.528620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b470e5-0ca0-4892-ae3e-f8622dfc2838 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:04.528888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b470e5-0ca0-4892-ae3e-f8622dfc2838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:04.529153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b470e5-0ca0-4892-ae3e-f8622dfc2838 admin admin] PATH_INFO: `/v3/projects/890dca85d3164528880613bf0afcbf95` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:04.530622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b470e5-0ca0-4892-ae3e-f8622dfc2838 admin admin] RBAC: Authorizing `identity:get_project(project_id=890dca85d3164528880613bf0afcbf95)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:20:04.532394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b470e5-0ca0-4892-ae3e-f8622dfc2838 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:20:04.534082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 746/1503] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:20:04 2022] GET /identity/v3/projects/890dca85d3164528880613bf0afcbf95 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:20:04.545811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4626ea-14d4-435a-aa53-be133481849a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:20:04.555671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4626ea-14d4-435a-aa53-be133481849a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:20:04.560078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0f96d-8e22-42ad-9d86-4733304ce555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:20:04.560708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0f96d-8e22-42ad-9d86-4733304ce555 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:04.560981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0f96d-8e22-42ad-9d86-4733304ce555 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:04.561253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0f96d-8e22-42ad-9d86-4733304ce555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:04.570925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0f96d-8e22-42ad-9d86-4733304ce555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:20:04.572382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0f96d-8e22-42ad-9d86-4733304ce555 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:20:04.581774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 758/1504] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:20:07.048159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6e61-e124-4cea-b282-fdd67a321356 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:07.049103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6e61-e124-4cea-b282-fdd67a321356 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:07.049103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6e61-e124-4cea-b282-fdd67a321356 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:07.052169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 747/1505] 10.222.0.16 () {54 vars in 926 bytes} [Fri Jan 28 01:20:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:20:07.057788 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655391b3-44dd-45d7-9cf9-43c517feb0e5 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:07.058233 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655391b3-44dd-45d7-9cf9-43c517feb0e5 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:07.058336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655391b3-44dd-45d7-9cf9-43c517feb0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:07.077283 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-655391b3-44dd-45d7-9cf9-43c517feb0e5 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:20:07.078468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-655391b3-44dd-45d7-9cf9-43c517feb0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:20:07.086429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 759/1506] 10.222.0.16 () {58 vars in 1023 bytes} [Fri Jan 28 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:20:07.120648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d6e61-e124-4cea-b282-fdd67a321356 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:20:07.138755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d6e61-e124-4cea-b282-fdd67a321356 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:20:07.144525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a011e-feb5-48b3-9ce2-157a7dc78f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:20:07.145406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a011e-feb5-48b3-9ce2-157a7dc78f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:07.145706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a011e-feb5-48b3-9ce2-157a7dc78f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:07.145970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a011e-feb5-48b3-9ce2-157a7dc78f9e admin admin] PATH_INFO: `/v3/projects/890dca85d3164528880613bf0afcbf95` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:07.147179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a011e-feb5-48b3-9ce2-157a7dc78f9e admin admin] RBAC: Authorizing `identity:get_project(project_id=890dca85d3164528880613bf0afcbf95)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:20:07.148935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a011e-feb5-48b3-9ce2-157a7dc78f9e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:20:07.150706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 748/1507] 10.222.0.16 () {56 vars in 1207 bytes} [Fri Jan 28 01:20:07 2022] GET /identity/v3/projects/890dca85d3164528880613bf0afcbf95 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:20:07.162296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655391b3-44dd-45d7-9cf9-43c517feb0e5 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:20:07.171917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655391b3-44dd-45d7-9cf9-43c517feb0e5 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:20:07.176241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19099579-f31b-4ca9-b3fb-6471b8ce4ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:20:07.176889 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099579-f31b-4ca9-b3fb-6471b8ce4ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:20:07.177164 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099579-f31b-4ca9-b3fb-6471b8ce4ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:20:07.177473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099579-f31b-4ca9-b3fb-6471b8ce4ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:20:07.186807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19099579-f31b-4ca9-b3fb-6471b8ce4ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:20:07.188234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19099579-f31b-4ca9-b3fb-6471b8ce4ce1 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:20:07.198040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 760/1508] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:20:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:21:24.015660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55286-feb4-4e56-a3e4-f7ec47c50233 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.016289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55286-feb4-4e56-a3e4-f7ec47c50233 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.016289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d55286-feb4-4e56-a3e4-f7ec47c50233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.035973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a8d55286-feb4-4e56-a3e4-f7ec47c50233 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:21:24.037199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a8d55286-feb4-4e56-a3e4-f7ec47c50233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:21:24.046230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 749/1509] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:21:24.055437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397bc69-2170-44da-8f9c-4987ca167d78 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.056256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397bc69-2170-44da-8f9c-4987ca167d78 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.056256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397bc69-2170-44da-8f9c-4987ca167d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.079778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-a397bc69-2170-44da-8f9c-4987ca167d78 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:21:24.080939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a397bc69-2170-44da-8f9c-4987ca167d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:21:24.089886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 761/1510] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:21:24.094521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d55286-feb4-4e56-a3e4-f7ec47c50233 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:21:24.104534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d55286-feb4-4e56-a3e4-f7ec47c50233 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:21:24.110057 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da45e62-bed1-4559-bd5e-0e071a611c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:21:24.110666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da45e62-bed1-4559-bd5e-0e071a611c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.110939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da45e62-bed1-4559-bd5e-0e071a611c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.111206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da45e62-bed1-4559-bd5e-0e071a611c4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.111923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da45e62-bed1-4559-bd5e-0e071a611c4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:21:24.112214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da45e62-bed1-4559-bd5e-0e071a611c4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:21:24.113831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da45e62-bed1-4559-bd5e-0e071a611c4d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:21:24.126323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 750/1511] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:21:24.134426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397bc69-2170-44da-8f9c-4987ca167d78 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:21:24.143845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397bc69-2170-44da-8f9c-4987ca167d78 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:21:24.149981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b63a3-bedf-4c32-8973-ca4064398023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:21:24.150628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b63a3-bedf-4c32-8973-ca4064398023 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.151538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b63a3-bedf-4c32-8973-ca4064398023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.151818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b63a3-bedf-4c32-8973-ca4064398023 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.152524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b63a3-bedf-4c32-8973-ca4064398023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:21:24.154460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b63a3-bedf-4c32-8973-ca4064398023 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:21:24.193674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 762/1512] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:21:24 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:21:24.198017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da45e62-bed1-4559-bd5e-0e071a611c4d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:21:24.208055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da45e62-bed1-4559-bd5e-0e071a611c4d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:21:24.270569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddf308-aa8f-42d1-8b8d-c68e45b12f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:21:24.271410 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf308-aa8f-42d1-8b8d-c68e45b12f89 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.271684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf308-aa8f-42d1-8b8d-c68e45b12f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.271952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ddf308-aa8f-42d1-8b8d-c68e45b12f89 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.272649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddf308-aa8f-42d1-8b8d-c68e45b12f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:21:24.274631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ddf308-aa8f-42d1-8b8d-c68e45b12f89 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:21:24.296264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 751/1513] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:21:24 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:21:24.300600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b63a3-bedf-4c32-8973-ca4064398023 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:21:24.311028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b63a3-bedf-4c32-8973-ca4064398023 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:21:24.316636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dedd9c-081a-4e6c-8afc-d050a1158a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:21:24.317329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dedd9c-081a-4e6c-8afc-d050a1158a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.317609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dedd9c-081a-4e6c-8afc-d050a1158a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.317878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dedd9c-081a-4e6c-8afc-d050a1158a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.318622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dedd9c-081a-4e6c-8afc-d050a1158a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:21:24.320227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dedd9c-081a-4e6c-8afc-d050a1158a1f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:21:24.333262 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 763/1514] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:21:24.337457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddf308-aa8f-42d1-8b8d-c68e45b12f89 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:21:24.350468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ddf308-aa8f-42d1-8b8d-c68e45b12f89 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:21:24.357895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc542b27-b033-49b9-8fe4-bd0495fc3959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:21:24.358810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542b27-b033-49b9-8fe4-bd0495fc3959 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.359156 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542b27-b033-49b9-8fe4-bd0495fc3959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.359499 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542b27-b033-49b9-8fe4-bd0495fc3959 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.360605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc542b27-b033-49b9-8fe4-bd0495fc3959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:21:24.362969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc542b27-b033-49b9-8fe4-bd0495fc3959 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:21:24.377019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 752/1515] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:21:24.381357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dedd9c-081a-4e6c-8afc-d050a1158a1f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:21:24.391715 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dedd9c-081a-4e6c-8afc-d050a1158a1f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:21:24.397647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0dde4-99e9-4d4b-9dd5-f3e172697ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:21:24.398501 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0dde4-99e9-4d4b-9dd5-f3e172697ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.398776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0dde4-99e9-4d4b-9dd5-f3e172697ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.399046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0dde4-99e9-4d4b-9dd5-f3e172697ac4 admin admin] PATH_INFO: `/v3/projects/98f3c87a21b044be82b2e3aaeff7150c/users/76c09c6ca9714a378692b76aa003017e/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.414933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0dde4-99e9-4d4b-9dd5-f3e172697ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f3c87a21b044be82b2e3aaeff7150c, user_id=76c09c6ca9714a378692b76aa003017e, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:21:24.417633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0dde4-99e9-4d4b-9dd5-f3e172697ac4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:21:24.434577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 764/1516] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:21:24 2022] PUT /identity/v3/projects/98f3c87a21b044be82b2e3aaeff7150c/users/76c09c6ca9714a378692b76aa003017e/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:21:24.447109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbda41-d117-471d-a393-1b80f849e3ac None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.447439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbda41-d117-471d-a393-1b80f849e3ac None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.447696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbda41-d117-471d-a393-1b80f849e3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.474838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f2bbda41-d117-471d-a393-1b80f849e3ac None None] MFA Rules not processed for user `76c09c6ca9714a378692b76aa003017e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:21:24.476035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f2bbda41-d117-471d-a393-1b80f849e3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:21:24.538966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 753/1517] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:21:24.550969 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0dde4-99e9-4d4b-9dd5-f3e172697ac4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:21:24.632654 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0dde4-99e9-4d4b-9dd5-f3e172697ac4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:21:24.639681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91c7a9-240f-41fb-8318-b60bbc2e6762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:21:24.640328 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91c7a9-240f-41fb-8318-b60bbc2e6762 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.640604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91c7a9-240f-41fb-8318-b60bbc2e6762 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.640867 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91c7a9-240f-41fb-8318-b60bbc2e6762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.648903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91c7a9-240f-41fb-8318-b60bbc2e6762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:21:24.650569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91c7a9-240f-41fb-8318-b60bbc2e6762 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:21:24.659584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 765/1518] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:21:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:21:24.736530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac71fe-17ce-49e0-905b-4497fc315461 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.736816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac71fe-17ce-49e0-905b-4497fc315461 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.737094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac71fe-17ce-49e0-905b-4497fc315461 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.738831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 754/1519] 10.222.0.16 () {52 vars in 829 bytes} [Fri Jan 28 01:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:21:24.742683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91c7a9-240f-41fb-8318-b60bbc2e6762 service nova] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:21:24.809154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91c7a9-240f-41fb-8318-b60bbc2e6762 service nova] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:21:24.814405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:21:24.815273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.815581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.815831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] PATH_INFO: `/v3/users/76c09c6ca9714a378692b76aa003017e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.817094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c09c6ca9714a378692b76aa003017e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:21:24.818258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:21:24.818258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:21:24.818258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:21:24.819468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:21:24.884890 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c09c6ca9714a378692b76aa003017e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:21:24.897422 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c09c6ca9714a378692b76aa003017e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:21:24.898390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c09c6ca9714a378692b76aa003017e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:21:24.910550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c09c6ca9714a378692b76aa003017e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:21:24.938412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c09c6ca9714a378692b76aa003017e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:21:24.944653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 766/1520] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:21:24 2022] DELETE /identity/v3/users/76c09c6ca9714a378692b76aa003017e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:21:24.949511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85549-63b8-496e-9b0b-bea22f3ac512 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:24.949835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85549-63b8-496e-9b0b-bea22f3ac512 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:24.950139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85549-63b8-496e-9b0b-bea22f3ac512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:24.968438 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9dc85549-63b8-496e-9b0b-bea22f3ac512 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:21:24.969683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9dc85549-63b8-496e-9b0b-bea22f3ac512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:21:25.035739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 755/1521] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:21:25.046118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:21:25.047571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:21:25.103301 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311a669-8869-404f-9d94-d408c3f666f4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:21:25.107187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077cb1a-9a98-459b-9e66-fb740ff5757a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:21:25.107825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077cb1a-9a98-459b-9e66-fb740ff5757a service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:25.108104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077cb1a-9a98-459b-9e66-fb740ff5757a service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:25.108380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077cb1a-9a98-459b-9e66-fb740ff5757a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:25.117690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077cb1a-9a98-459b-9e66-fb740ff5757a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:21:25.119123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077cb1a-9a98-459b-9e66-fb740ff5757a service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:21:25.128570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 767/1522] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:21:25.475947 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85549-63b8-496e-9b0b-bea22f3ac512 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:21:25.478252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9dc85549-63b8-496e-9b0b-bea22f3ac512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:21:25.490720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85549-63b8-496e-9b0b-bea22f3ac512 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:21:25.496095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:21:25.496984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:21:25.497271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:21:25.497558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] PATH_INFO: `/v3/projects/98f3c87a21b044be82b2e3aaeff7150c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:21:25.498804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f3c87a21b044be82b2e3aaeff7150c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:21:25.499817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:21:25.499817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:21:25.499817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:21:25.501022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:21:25.567652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f3c87a21b044be82b2e3aaeff7150c', 'request_id': 'req-b4b494ef-d385-43e6-86c0-07f168089111'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:21:25.579690 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f3c87a21b044be82b2e3aaeff7150c', 'request_id': 'req-b4b494ef-d385-43e6-86c0-07f168089111'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:21:25.595426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f3c87a21b044be82b2e3aaeff7150c', 'request_id': 'req-b4b494ef-d385-43e6-86c0-07f168089111'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:21:25.607047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] The token cache is being invalidate because project 98f3c87a21b044be82b2e3aaeff7150c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:21:25.607327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:21:25.608039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b4b494ef-d385-43e6-86c0-07f168089111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:21:25.609684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 756/1523] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:21:25 2022] DELETE /identity/v3/projects/98f3c87a21b044be82b2e3aaeff7150c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:23:01.441933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0ddf5-ee79-46ec-a8ae-e672a2532a6e None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:01.442601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0ddf5-ee79-46ec-a8ae-e672a2532a6e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:01.442601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0ddf5-ee79-46ec-a8ae-e672a2532a6e None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:01.444315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 768/1524] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:23:01.450883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb332a3-34ef-4f72-b4cb-1cbe2dcf2843 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:01.451735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb332a3-34ef-4f72-b4cb-1cbe2dcf2843 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:01.451735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb332a3-34ef-4f72-b4cb-1cbe2dcf2843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:01.479807 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4bb332a3-34ef-4f72-b4cb-1cbe2dcf2843 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:01.481655 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4bb332a3-34ef-4f72-b4cb-1cbe2dcf2843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:01.557719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 757/1525] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:23:01.598540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc29cd-13fc-4c61-8bda-ed9f7491c785 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:01.598984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc29cd-13fc-4c61-8bda-ed9f7491c785 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:01.599434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc29cd-13fc-4c61-8bda-ed9f7491c785 None None] PATH_INFO: `/v3` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:01.601564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 769/1526] 10.222.0.88 () {54 vars in 925 bytes} [Fri Jan 28 01:23:01 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:23:01.624333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ed49b-2c54-48ed-af22-a24846e9fbd6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:01.624637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ed49b-2c54-48ed-af22-a24846e9fbd6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:01.624992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ed49b-2c54-48ed-af22-a24846e9fbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:01.647147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e61ed49b-2c54-48ed-af22-a24846e9fbd6 None None] MFA Rules not processed for user `aac3e041554a4439bfa91520e52fbd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:01.648377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e61ed49b-2c54-48ed-af22-a24846e9fbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:01.724969 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc29cd-13fc-4c61-8bda-ed9f7491c785 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:23:01.727019 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e1cc29cd-13fc-4c61-8bda-ed9f7491c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:01.730640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 758/1527] 10.222.0.88 () {58 vars in 1015 bytes} [Fri Jan 28 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:23:01.830091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc29cd-13fc-4c61-8bda-ed9f7491c785 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:23:01.835865 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218c032-7744-48ce-8d5a-51ca9dc631da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:23:01.836934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218c032-7744-48ce-8d5a-51ca9dc631da service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:01.837215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218c032-7744-48ce-8d5a-51ca9dc631da service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:01.837601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218c032-7744-48ce-8d5a-51ca9dc631da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:01.853952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218c032-7744-48ce-8d5a-51ca9dc631da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:23:01.857016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218c032-7744-48ce-8d5a-51ca9dc631da service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:23:01.875359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 770/1528] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:23:03.258033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0d85-62a7-41a5-9b13-52de1418bb68 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:03.258817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0d85-62a7-41a5-9b13-52de1418bb68 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:03.258817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d0d85-62a7-41a5-9b13-52de1418bb68 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:03.260428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 759/1529] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:23:03.267746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac21d1-b372-4203-8010-91316ed310dc None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:03.268380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac21d1-b372-4203-8010-91316ed310dc None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:03.268631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac21d1-b372-4203-8010-91316ed310dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:03.292493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-5dac21d1-b372-4203-8010-91316ed310dc None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:03.293753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5dac21d1-b372-4203-8010-91316ed310dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:03.302254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 771/1530] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:23:03.459170 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0d85-62a7-41a5-9b13-52de1418bb68 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:23:03.475696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d0d85-62a7-41a5-9b13-52de1418bb68 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:23:03.481583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488738c-695e-4a1d-a73b-bbc04147d9f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:23:03.482261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488738c-695e-4a1d-a73b-bbc04147d9f3 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:03.482532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488738c-695e-4a1d-a73b-bbc04147d9f3 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:03.482802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488738c-695e-4a1d-a73b-bbc04147d9f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:03.493253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488738c-695e-4a1d-a73b-bbc04147d9f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:23:03.494875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488738c-695e-4a1d-a73b-bbc04147d9f3 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:23:03.505716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 760/1531] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:23:11.802115 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bda9d-8ce7-4d02-a5e0-aec2bae35a54 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:11.802638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bda9d-8ce7-4d02-a5e0-aec2bae35a54 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:11.802638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bda9d-8ce7-4d02-a5e0-aec2bae35a54 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:11.804744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 772/1532] 10.222.0.16 () {54 vars in 960 bytes} [Fri Jan 28 01:23:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:23:11.812354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76c18-afbe-4715-8b85-ceb6daed43db None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:11.812832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76c18-afbe-4715-8b85-ceb6daed43db None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:11.812938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76c18-afbe-4715-8b85-ceb6daed43db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:11.842680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-30a76c18-afbe-4715-8b85-ceb6daed43db None None] MFA Rules not processed for user `aac3e041554a4439bfa91520e52fbd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:11.843860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-30a76c18-afbe-4715-8b85-ceb6daed43db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:11.854011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 761/1533] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Jan 28 01:23:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:23:11.861780 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bda9d-8ce7-4d02-a5e0-aec2bae35a54 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:23:11.876990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bda9d-8ce7-4d02-a5e0-aec2bae35a54 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:23:11.883032 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7ed72-d456-45a7-9cff-d41a288fb3a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac3e041554a4439bfa91520e52fbd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:23:11.883679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7ed72-d456-45a7-9cff-d41a288fb3a9 service placement] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:11.883961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7ed72-d456-45a7-9cff-d41a288fb3a9 service placement] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:11.884252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7ed72-d456-45a7-9cff-d41a288fb3a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:11.893012 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7ed72-d456-45a7-9cff-d41a288fb3a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:23:11.894680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7ed72-d456-45a7-9cff-d41a288fb3a9 service placement] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:23:11.904318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 773/1534] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:23:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:23:15.233091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0155b-cb14-4555-a0b2-6ad389905aa5 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:15.233754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0155b-cb14-4555-a0b2-6ad389905aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:15.233754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0155b-cb14-4555-a0b2-6ad389905aa5 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:15.235495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 762/1535] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:23:15.241535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c88324-d8bd-4c2d-96f6-8514ecb54476 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:15.241991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c88324-d8bd-4c2d-96f6-8514ecb54476 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:15.242112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c88324-d8bd-4c2d-96f6-8514ecb54476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:15.269828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-74c88324-d8bd-4c2d-96f6-8514ecb54476 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:15.271035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-74c88324-d8bd-4c2d-96f6-8514ecb54476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:15.280524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 774/1536] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:23:15.437595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0155b-cb14-4555-a0b2-6ad389905aa5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:23:15.459863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0155b-cb14-4555-a0b2-6ad389905aa5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:23:15.466618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bec924-d69e-4df9-85b1-aa5fdd464f94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:23:15.467284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec924-d69e-4df9-85b1-aa5fdd464f94 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:15.467557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec924-d69e-4df9-85b1-aa5fdd464f94 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:15.467820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bec924-d69e-4df9-85b1-aa5fdd464f94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:15.476658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bec924-d69e-4df9-85b1-aa5fdd464f94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:23:15.478270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bec924-d69e-4df9-85b1-aa5fdd464f94 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:23:15.488291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 763/1537] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:23:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:23:16.760865 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2c2f-936d-48d6-b780-c3252362f311 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:16.761872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2c2f-936d-48d6-b780-c3252362f311 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:16.761872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2c2f-936d-48d6-b780-c3252362f311 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:16.764645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 775/1538] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jan 28 01:23:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:23:16.769769 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16767dbc-707b-450e-acba-a95bce04ac2b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:16.770322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16767dbc-707b-450e-acba-a95bce04ac2b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:16.770322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16767dbc-707b-450e-acba-a95bce04ac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:16.788465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-16767dbc-707b-450e-acba-a95bce04ac2b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:16.789690 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-16767dbc-707b-450e-acba-a95bce04ac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:16.797807 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 764/1539] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jan 28 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:23:16.952968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b2c2f-936d-48d6-b780-c3252362f311 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:23:16.975266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b2c2f-936d-48d6-b780-c3252362f311 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:23:16.985373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69168146-bd38-4ffb-bba0-a86de701b4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:23:16.986280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168146-bd38-4ffb-bba0-a86de701b4cc service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:16.986592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168146-bd38-4ffb-bba0-a86de701b4cc service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:16.986868 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168146-bd38-4ffb-bba0-a86de701b4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:16.995461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69168146-bd38-4ffb-bba0-a86de701b4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:23:16.997066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69168146-bd38-4ffb-bba0-a86de701b4cc service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:23:17.006635 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 776/1540] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:23:21.622763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c335bc-02ff-4d44-8125-693ad357a2dd None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:21.623523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c335bc-02ff-4d44-8125-693ad357a2dd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:21.623523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c335bc-02ff-4d44-8125-693ad357a2dd None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:21.626529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 765/1541] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:23:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:23:21.632294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39d091-70ca-4cf1-9f93-cb7a890446cc None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:21.632747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39d091-70ca-4cf1-9f93-cb7a890446cc None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:21.632837 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39d091-70ca-4cf1-9f93-cb7a890446cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:21.651701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-3e39d091-70ca-4cf1-9f93-cb7a890446cc None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:21.652979 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3e39d091-70ca-4cf1-9f93-cb7a890446cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:21.663224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 777/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:23:21.704843 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c335bc-02ff-4d44-8125-693ad357a2dd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:23:21.707894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-82c335bc-02ff-4d44-8125-693ad357a2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:21.772064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c335bc-02ff-4d44-8125-693ad357a2dd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:23:21.776051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617deb5-ef6b-42d5-a9d7-6661284b26b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:23:21.776684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617deb5-ef6b-42d5-a9d7-6661284b26b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:21.776937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617deb5-ef6b-42d5-a9d7-6661284b26b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:21.777248 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617deb5-ef6b-42d5-a9d7-6661284b26b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:21.786775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617deb5-ef6b-42d5-a9d7-6661284b26b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:23:21.788500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617deb5-ef6b-42d5-a9d7-6661284b26b3 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:23:21.798546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 766/1543] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:23:23.989165 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17696b13-d5f7-474e-a10e-302fb6fb3274 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:23.989811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17696b13-d5f7-474e-a10e-302fb6fb3274 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:23.989811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17696b13-d5f7-474e-a10e-302fb6fb3274 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:23.991540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 778/1544] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:23:23.998041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d296243-cfc5-4f7f-baac-9142a9c9de4e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:23.998731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d296243-cfc5-4f7f-baac-9142a9c9de4e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:23.998897 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d296243-cfc5-4f7f-baac-9142a9c9de4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:24.019884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0d296243-cfc5-4f7f-baac-9142a9c9de4e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:24.021117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0d296243-cfc5-4f7f-baac-9142a9c9de4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:24.030352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 767/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:23:24.068692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17696b13-d5f7-474e-a10e-302fb6fb3274 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:23:24.081642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17696b13-d5f7-474e-a10e-302fb6fb3274 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:23:24.086885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96f7f1-3e68-4201-a2a0-0753bbb4a6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:23:24.087538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96f7f1-3e68-4201-a2a0-0753bbb4a6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:24.087819 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96f7f1-3e68-4201-a2a0-0753bbb4a6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:24.088093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96f7f1-3e68-4201-a2a0-0753bbb4a6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:24.098141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96f7f1-3e68-4201-a2a0-0753bbb4a6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:23:24.099579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96f7f1-3e68-4201-a2a0-0753bbb4a6b9 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:23:24.109132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 779/1546] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:23:28.161278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400829d5-7d32-4fd3-9e77-188eb808a5c6 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:28.161878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400829d5-7d32-4fd3-9e77-188eb808a5c6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:28.161878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400829d5-7d32-4fd3-9e77-188eb808a5c6 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:28.163682 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 768/1547] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:23:28.170200 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42956a-3ae3-48f1-93fa-e26343833478 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:28.170929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42956a-3ae3-48f1-93fa-e26343833478 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:28.171116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42956a-3ae3-48f1-93fa-e26343833478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:28.193214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ff42956a-3ae3-48f1-93fa-e26343833478 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:28.194455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ff42956a-3ae3-48f1-93fa-e26343833478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:28.202794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 780/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:23:28.472610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400829d5-7d32-4fd3-9e77-188eb808a5c6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:23:28.475782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-400829d5-7d32-4fd3-9e77-188eb808a5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:28.544178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400829d5-7d32-4fd3-9e77-188eb808a5c6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:23:28.548505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270a2b5-a07a-43c3-84c1-540bb1a73ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:23:28.549155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270a2b5-a07a-43c3-84c1-540bb1a73ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:28.549469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270a2b5-a07a-43c3-84c1-540bb1a73ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:28.549741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270a2b5-a07a-43c3-84c1-540bb1a73ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:28.559185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270a2b5-a07a-43c3-84c1-540bb1a73ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:23:28.560628 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270a2b5-a07a-43c3-84c1-540bb1a73ac0 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:23:28.570199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 769/1549] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:23:30.812547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b40887-204a-4b4c-9373-d881bd056bf0 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:30.813416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b40887-204a-4b4c-9373-d881bd056bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:30.813416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b40887-204a-4b4c-9373-d881bd056bf0 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:30.816156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 781/1550] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jan 28 01:23:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:23:30.823277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccdc2a-8d45-46af-a35c-b069998aa7ea None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:30.823681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccdc2a-8d45-46af-a35c-b069998aa7ea None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:30.823820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccdc2a-8d45-46af-a35c-b069998aa7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:30.844787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d1ccdc2a-8d45-46af-a35c-b069998aa7ea None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:30.846003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d1ccdc2a-8d45-46af-a35c-b069998aa7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:30.854266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 770/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jan 28 01:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:23:31.107973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70c96b-2ab5-4a1d-9697-0acbba18e0ee None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:31.108301 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70c96b-2ab5-4a1d-9697-0acbba18e0ee None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:31.108716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70c96b-2ab5-4a1d-9697-0acbba18e0ee None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:31.111611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 782/1552] 10.222.0.16 () {54 vars in 963 bytes} [Fri Jan 28 01:23:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:23:31.118519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b535a65-8dbb-43b4-bcd3-c43f46dc2b19 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:31.118796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b535a65-8dbb-43b4-bcd3-c43f46dc2b19 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:31.119069 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b535a65-8dbb-43b4-bcd3-c43f46dc2b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:31.139037 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9b535a65-8dbb-43b4-bcd3-c43f46dc2b19 None None] MFA Rules not processed for user `a19c46c2ecd746d7a6e10c09d706a675`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:23:31.140244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9b535a65-8dbb-43b4-bcd3-c43f46dc2b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:23:31.148359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 771/1553] 10.222.0.16 () {58 vars in 1060 bytes} [Fri Jan 28 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:23:31.156234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70c96b-2ab5-4a1d-9697-0acbba18e0ee None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:23:31.172925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70c96b-2ab5-4a1d-9697-0acbba18e0ee None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:23:31.179479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd023e6-d7ee-454f-9f55-6634c178b584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:23:31.180112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd023e6-d7ee-454f-9f55-6634c178b584 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:23:31.180387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd023e6-d7ee-454f-9f55-6634c178b584 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:23:31.180742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd023e6-d7ee-454f-9f55-6634c178b584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:23:31.190050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd023e6-d7ee-454f-9f55-6634c178b584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:23:31.191643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd023e6-d7ee-454f-9f55-6634c178b584 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:23:31.201509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 783/1554] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:24:55.420823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b10874-3d48-4349-a787-d460a6d8e92d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.422348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12505068-2616-4687-81eb-b29039808059 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.422766 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b10874-3d48-4349-a787-d460a6d8e92d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.422855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12505068-2616-4687-81eb-b29039808059 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.422942 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b10874-3d48-4349-a787-d460a6d8e92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.423027 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12505068-2616-4687-81eb-b29039808059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.444428 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-12505068-2616-4687-81eb-b29039808059 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:55.445663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-12505068-2616-4687-81eb-b29039808059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:55.453512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-88b10874-3d48-4349-a787-d460a6d8e92d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:55.454716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-88b10874-3d48-4349-a787-d460a6d8e92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:55.460176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 784/1555] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:55.461909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ab437-99f5-48db-a38c-b1cbaea9b097 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.462206 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ab437-99f5-48db-a38c-b1cbaea9b097 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.462482 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ab437-99f5-48db-a38c-b1cbaea9b097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.470592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 772/1556] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:55.479106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7828a2-bc47-45db-8d3a-ee39b249ea76 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.479667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7828a2-bc47-45db-8d3a-ee39b249ea76 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.480170 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7828a2-bc47-45db-8d3a-ee39b249ea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.489598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-f00ab437-99f5-48db-a38c-b1cbaea9b097 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:55.490986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f00ab437-99f5-48db-a38c-b1cbaea9b097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:55.506576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 785/1557] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:55.508011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae623c-314c-410c-b308-121ee7d61783 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.508525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae623c-314c-410c-b308-121ee7d61783 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.508815 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae623c-314c-410c-b308-121ee7d61783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.522719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1e7828a2-bc47-45db-8d3a-ee39b249ea76 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:55.524239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1e7828a2-bc47-45db-8d3a-ee39b249ea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:55.538763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-efae623c-314c-410c-b308-121ee7d61783 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:55.540288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-efae623c-314c-410c-b308-121ee7d61783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:55.555566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 773/1559] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:24:55.555778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 786/1559] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:55.557112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f461f-aac1-4e61-aad2-0660f6fb03a0 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.557428 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f461f-aac1-4e61-aad2-0660f6fb03a0 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.557706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f461f-aac1-4e61-aad2-0660f6fb03a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.569122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7828a2-bc47-45db-8d3a-ee39b249ea76 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:55.578658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7828a2-bc47-45db-8d3a-ee39b249ea76 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:55.586963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b19f461f-aac1-4e61-aad2-0660f6fb03a0 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:55.588160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b19f461f-aac1-4e61-aad2-0660f6fb03a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:55.593892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2a121-58cd-489a-b03e-dba551771a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:55.594571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2a121-58cd-489a-b03e-dba551771a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.594853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2a121-58cd-489a-b03e-dba551771a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.595129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2a121-58cd-489a-b03e-dba551771a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.596022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2a121-58cd-489a-b03e-dba551771a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:24:55.596331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2a121-58cd-489a-b03e-dba551771a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:55.598206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2a121-58cd-489a-b03e-dba551771a8b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:55.607760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 787/1560] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:55.608797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f461f-aac1-4e61-aad2-0660f6fb03a0 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:55.627875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f461f-aac1-4e61-aad2-0660f6fb03a0 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:55.628098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 774/1561] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:24:55.628551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2a121-58cd-489a-b03e-dba551771a8b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:55.640039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330e0df-e442-4cdf-b788-d39b5f4b175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:55.640730 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330e0df-e442-4cdf-b788-d39b5f4b175a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.641008 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330e0df-e442-4cdf-b788-d39b5f4b175a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.641302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330e0df-e442-4cdf-b788-d39b5f4b175a admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.642050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330e0df-e442-4cdf-b788-d39b5f4b175a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:24:55.642352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330e0df-e442-4cdf-b788-d39b5f4b175a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:55.644079 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330e0df-e442-4cdf-b788-d39b5f4b175a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:55.655788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2a121-58cd-489a-b03e-dba551771a8b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:55.668023 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 788/1562] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:24:55.669021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330e0df-e442-4cdf-b788-d39b5f4b175a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:55.682538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330e0df-e442-4cdf-b788-d39b5f4b175a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:55.686967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084ff1a-bf04-4f65-a84b-469c8b7dfe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:55.687656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ff1a-bf04-4f65-a84b-469c8b7dfe34 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.687937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ff1a-bf04-4f65-a84b-469c8b7dfe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.688211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084ff1a-bf04-4f65-a84b-469c8b7dfe34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.688961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ff1a-bf04-4f65-a84b-469c8b7dfe34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:24:55.689577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ff1a-bf04-4f65-a84b-469c8b7dfe34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:55.691449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084ff1a-bf04-4f65-a84b-469c8b7dfe34 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:55.691714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd81e57-834b-41e9-abba-0fce21c5d9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:55.692378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd81e57-834b-41e9-abba-0fce21c5d9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.692659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd81e57-834b-41e9-abba-0fce21c5d9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.692930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd81e57-834b-41e9-abba-0fce21c5d9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.693662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd81e57-834b-41e9-abba-0fce21c5d9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:55.695571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd81e57-834b-41e9-abba-0fce21c5d9d3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:55.715996 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 775/1563] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:24:55.717916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d267b3-01e1-4c43-bf14-e50ef7506982 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.718426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d267b3-01e1-4c43-bf14-e50ef7506982 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.718743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d267b3-01e1-4c43-bf14-e50ef7506982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.745248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 789/1564] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:55.746194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd81e57-834b-41e9-abba-0fce21c5d9d3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:55.772638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c9d267b3-01e1-4c43-bf14-e50ef7506982 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:55.773854 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c9d267b3-01e1-4c43-bf14-e50ef7506982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:55.867314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 776/1565] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:55.868143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d267b3-01e1-4c43-bf14-e50ef7506982 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:55.877579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd81e57-834b-41e9-abba-0fce21c5d9d3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:55.877939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d267b3-01e1-4c43-bf14-e50ef7506982 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:55.882349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b3594-8fab-4832-a07f-d3b907c15be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:55.882740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a339f6-e342-4aa9-b0c0-bf4c2798b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:55.883131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3594-8fab-4832-a07f-d3b907c15be4 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.883391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a339f6-e342-4aa9-b0c0-bf4c2798b399 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.883490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3594-8fab-4832-a07f-d3b907c15be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.883671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3594-8fab-4832-a07f-d3b907c15be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.883779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a339f6-e342-4aa9-b0c0-bf4c2798b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.883943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a339f6-e342-4aa9-b0c0-bf4c2798b399 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.884374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b3594-8fab-4832-a07f-d3b907c15be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:55.884646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a339f6-e342-4aa9-b0c0-bf4c2798b399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:55.886443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b3594-8fab-4832-a07f-d3b907c15be4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:55.887185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a339f6-e342-4aa9-b0c0-bf4c2798b399 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:55.913289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 790/1566] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/projects => generated 393 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:55.914453 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b3594-8fab-4832-a07f-d3b907c15be4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:55.925886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 777/1567] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:55.925886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9a6b-7d61-4bf5-bdd8-f3c34466c6cf None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:55.925886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9a6b-7d61-4bf5-bdd8-f3c34466c6cf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:55.925886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac9a6b-7d61-4bf5-bdd8-f3c34466c6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:55.942629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-18ac9a6b-7d61-4bf5-bdd8-f3c34466c6cf None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:55.943722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-18ac9a6b-7d61-4bf5-bdd8-f3c34466c6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:55.979907 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b3594-8fab-4832-a07f-d3b907c15be4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.002397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 778/1568] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:56.003709 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfcb9b-f424-4301-98dd-77635d2e2a65 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.003992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfcb9b-f424-4301-98dd-77635d2e2a65 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.004264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfcb9b-f424-4301-98dd-77635d2e2a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.022114 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f7dfcb9b-f424-4301-98dd-77635d2e2a65 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:56.023291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f7dfcb9b-f424-4301-98dd-77635d2e2a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:56.031558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 779/1569] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:56.032754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55895830-6ab6-44cb-8399-61334ac949d6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.033058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55895830-6ab6-44cb-8399-61334ac949d6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.033356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55895830-6ab6-44cb-8399-61334ac949d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.040493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368f338-973e-4f09-a7cf-0279aa92dee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.041166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368f338-973e-4f09-a7cf-0279aa92dee2 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.041484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368f338-973e-4f09-a7cf-0279aa92dee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.041756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368f338-973e-4f09-a7cf-0279aa92dee2 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.042520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368f338-973e-4f09-a7cf-0279aa92dee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.044500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368f338-973e-4f09-a7cf-0279aa92dee2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.053520 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-55895830-6ab6-44cb-8399-61334ac949d6 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:56.054701 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-55895830-6ab6-44cb-8399-61334ac949d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:56.064096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 780/1570] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:56.070852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 791/1571] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:24:55 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.070988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56521f-5121-453e-86b8-1d44430a7213 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.070988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56521f-5121-453e-86b8-1d44430a7213 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.071168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368f338-973e-4f09-a7cf-0279aa92dee2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.071256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56521f-5121-453e-86b8-1d44430a7213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.077364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368f338-973e-4f09-a7cf-0279aa92dee2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.082149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b66d4-20a9-40b9-86a8-39c60467783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.082804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b66d4-20a9-40b9-86a8-39c60467783a admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.083086 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b66d4-20a9-40b9-86a8-39c60467783a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.083361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b66d4-20a9-40b9-86a8-39c60467783a admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.084146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b66d4-20a9-40b9-86a8-39c60467783a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.086426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b66d4-20a9-40b9-86a8-39c60467783a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.088873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-dd56521f-5121-453e-86b8-1d44430a7213 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:56.090227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dd56521f-5121-453e-86b8-1d44430a7213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:56.098396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 781/1572] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:56.099429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56521f-5121-453e-86b8-1d44430a7213 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.107404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 792/1573] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.108915 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2229db-34ed-4266-8a15-2ddc27f9da1e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.109207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2229db-34ed-4266-8a15-2ddc27f9da1e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.109512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2229db-34ed-4266-8a15-2ddc27f9da1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.112887 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56521f-5121-453e-86b8-1d44430a7213 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.117698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa0c2f-d95c-4fd3-a41e-2c86e1044ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.118351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa0c2f-d95c-4fd3-a41e-2c86e1044ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.118628 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa0c2f-d95c-4fd3-a41e-2c86e1044ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.118918 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa0c2f-d95c-4fd3-a41e-2c86e1044ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.119617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa0c2f-d95c-4fd3-a41e-2c86e1044ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.121557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa0c2f-d95c-4fd3-a41e-2c86e1044ee9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.126790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-dd2229db-34ed-4266-8a15-2ddc27f9da1e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:56.127984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-dd2229db-34ed-4266-8a15-2ddc27f9da1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:56.136153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 793/1574] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:56.143523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be415e-61df-42cf-a4aa-a028755b3303 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.143523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be415e-61df-42cf-a4aa-a028755b3303 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.143523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be415e-61df-42cf-a4aa-a028755b3303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.143841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 782/1575] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.145029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6cf4d-8c32-48e3-8036-2a674b0ff537 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.145325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6cf4d-8c32-48e3-8036-2a674b0ff537 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.145617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6cf4d-8c32-48e3-8036-2a674b0ff537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.159397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-62be415e-61df-42cf-a4aa-a028755b3303 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:56.160581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-62be415e-61df-42cf-a4aa-a028755b3303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:56.163701 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-fba6cf4d-8c32-48e3-8036-2a674b0ff537 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:56.164885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fba6cf4d-8c32-48e3-8036-2a674b0ff537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:56.168907 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 794/1576] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:56.169774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be415e-61df-42cf-a4aa-a028755b3303 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.177142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 783/1577] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:56.178425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0145a63-653e-4d03-b6f4-663cd4367c5d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.178720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0145a63-653e-4d03-b6f4-663cd4367c5d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.178878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be415e-61df-42cf-a4aa-a028755b3303 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.178962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0145a63-653e-4d03-b6f4-663cd4367c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.183806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70529f0d-4fd5-4245-a20e-1320eb5b26b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.184498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70529f0d-4fd5-4245-a20e-1320eb5b26b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.184767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70529f0d-4fd5-4245-a20e-1320eb5b26b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.185040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70529f0d-4fd5-4245-a20e-1320eb5b26b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.185814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70529f0d-4fd5-4245-a20e-1320eb5b26b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.187420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70529f0d-4fd5-4245-a20e-1320eb5b26b0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.196943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c0145a63-653e-4d03-b6f4-663cd4367c5d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:56.197288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 795/1578] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:56.198079 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70529f0d-4fd5-4245-a20e-1320eb5b26b0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.198204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c0145a63-653e-4d03-b6f4-663cd4367c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:56.206422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 784/1579] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:56.207274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0145a63-653e-4d03-b6f4-663cd4367c5d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.207384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70529f0d-4fd5-4245-a20e-1320eb5b26b0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.214475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a58ba1-78a1-4591-80d4-27715beda451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.215124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a58ba1-78a1-4591-80d4-27715beda451 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.215402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a58ba1-78a1-4591-80d4-27715beda451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.215717 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a58ba1-78a1-4591-80d4-27715beda451 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.216447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a58ba1-78a1-4591-80d4-27715beda451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:24:56.216751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a58ba1-78a1-4591-80d4-27715beda451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.218442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a58ba1-78a1-4591-80d4-27715beda451 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.219344 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0145a63-653e-4d03-b6f4-663cd4367c5d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.224087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52f60-3520-4bef-a5f8-5c3106e26c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.224725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52f60-3520-4bef-a5f8-5c3106e26c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.224992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52f60-3520-4bef-a5f8-5c3106e26c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.225320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c52f60-3520-4bef-a5f8-5c3106e26c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.226055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c52f60-3520-4bef-a5f8-5c3106e26c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.227685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c52f60-3520-4bef-a5f8-5c3106e26c16 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.230838 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 796/1580] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:24:56.232132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380c9a2-45e4-43de-b8a8-097a431db282 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.232420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380c9a2-45e4-43de-b8a8-097a431db282 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.232693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380c9a2-45e4-43de-b8a8-097a431db282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.243596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 785/1581] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:56.244442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52f60-3520-4bef-a5f8-5c3106e26c16 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.253898 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c52f60-3520-4bef-a5f8-5c3106e26c16 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.257120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-6380c9a2-45e4-43de-b8a8-097a431db282 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:56.258403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6380c9a2-45e4-43de-b8a8-097a431db282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:56.258538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0c492-71c7-4392-be82-dd23c2b30c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.259176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0c492-71c7-4392-be82-dd23c2b30c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.259447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0c492-71c7-4392-be82-dd23c2b30c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.259715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0c492-71c7-4392-be82-dd23c2b30c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.260439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0c492-71c7-4392-be82-dd23c2b30c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.262054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0c492-71c7-4392-be82-dd23c2b30c91 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.266720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 797/1582] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:56.267579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380c9a2-45e4-43de-b8a8-097a431db282 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.275951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 786/1583] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:56.275951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0c492-71c7-4392-be82-dd23c2b30c91 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.277317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380c9a2-45e4-43de-b8a8-097a431db282 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.282407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59352b-135b-4a23-99f1-d49d9acf558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.283050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59352b-135b-4a23-99f1-d49d9acf558a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.283326 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59352b-135b-4a23-99f1-d49d9acf558a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.283594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59352b-135b-4a23-99f1-d49d9acf558a admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.283697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0c492-71c7-4392-be82-dd23c2b30c91 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.284470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59352b-135b-4a23-99f1-d49d9acf558a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:24:56.284773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59352b-135b-4a23-99f1-d49d9acf558a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.286548 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59352b-135b-4a23-99f1-d49d9acf558a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.288885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86026551-bd6e-443f-ba4b-2e8596ccb6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.289553 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86026551-bd6e-443f-ba4b-2e8596ccb6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.289835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86026551-bd6e-443f-ba4b-2e8596ccb6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.290106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86026551-bd6e-443f-ba4b-2e8596ccb6f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.290829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86026551-bd6e-443f-ba4b-2e8596ccb6f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:24:56.291133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86026551-bd6e-443f-ba4b-2e8596ccb6f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.292683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86026551-bd6e-443f-ba4b-2e8596ccb6f9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.298677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 798/1584] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:24:56.299763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59352b-135b-4a23-99f1-d49d9acf558a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.309364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59352b-135b-4a23-99f1-d49d9acf558a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.311370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 787/1585] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:24:56.312238 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86026551-bd6e-443f-ba4b-2e8596ccb6f9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.314721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d8939-3e9f-4b3d-a0b2-834849b8ac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.315375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d8939-3e9f-4b3d-a0b2-834849b8ac5c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.315651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d8939-3e9f-4b3d-a0b2-834849b8ac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.315934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d8939-3e9f-4b3d-a0b2-834849b8ac5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.316666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d8939-3e9f-4b3d-a0b2-834849b8ac5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.318636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d8939-3e9f-4b3d-a0b2-834849b8ac5c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.321991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86026551-bd6e-443f-ba4b-2e8596ccb6f9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.326705 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982029c-e8e4-4190-b303-0e453b65e7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.327347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982029c-e8e4-4190-b303-0e453b65e7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.327625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982029c-e8e4-4190-b303-0e453b65e7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.327899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982029c-e8e4-4190-b303-0e453b65e7c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.328728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 799/1586] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:56.328894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982029c-e8e4-4190-b303-0e453b65e7c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:24:56.329212 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982029c-e8e4-4190-b303-0e453b65e7c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.329711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d8939-3e9f-4b3d-a0b2-834849b8ac5c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.331000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982029c-e8e4-4190-b303-0e453b65e7c3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.339609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d8939-3e9f-4b3d-a0b2-834849b8ac5c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.343301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 788/1587] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:24:56.344087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982029c-e8e4-4190-b303-0e453b65e7c3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.351492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b584e-2f20-419b-aa0f-81935f3e8049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.352147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b584e-2f20-419b-aa0f-81935f3e8049 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.352455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b584e-2f20-419b-aa0f-81935f3e8049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.352727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b584e-2f20-419b-aa0f-81935f3e8049 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.353021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982029c-e8e4-4190-b303-0e453b65e7c3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.353472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b584e-2f20-419b-aa0f-81935f3e8049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.355404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b584e-2f20-419b-aa0f-81935f3e8049 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.357736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c4d0-d14b-4689-8456-59ac61652c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.358371 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c4d0-d14b-4689-8456-59ac61652c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.358647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c4d0-d14b-4689-8456-59ac61652c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.358923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680c4d0-d14b-4689-8456-59ac61652c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.359815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680c4d0-d14b-4689-8456-59ac61652c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.361300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680c4d0-d14b-4689-8456-59ac61652c4c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.374578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 789/1588] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:56.375409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c4d0-d14b-4689-8456-59ac61652c4c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.385311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680c4d0-d14b-4689-8456-59ac61652c4c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.390143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a709f-67fe-498f-b15e-2b4f2ea4ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.393779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 800/1589] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.393905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a709f-67fe-498f-b15e-2b4f2ea4ca38 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.393905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a709f-67fe-498f-b15e-2b4f2ea4ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.393905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a709f-67fe-498f-b15e-2b4f2ea4ca38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.394179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b584e-2f20-419b-aa0f-81935f3e8049 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.394267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a709f-67fe-498f-b15e-2b4f2ea4ca38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:24:56.394267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a709f-67fe-498f-b15e-2b4f2ea4ca38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.394267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a709f-67fe-498f-b15e-2b4f2ea4ca38 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.405539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 790/1590] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:24:56.406300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a709f-67fe-498f-b15e-2b4f2ea4ca38 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.415756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a709f-67fe-498f-b15e-2b4f2ea4ca38 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.452240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b584e-2f20-419b-aa0f-81935f3e8049 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.457479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2118241-374b-4041-90c1-7764421b6f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.458153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2118241-374b-4041-90c1-7764421b6f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.458435 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2118241-374b-4041-90c1-7764421b6f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.458715 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2118241-374b-4041-90c1-7764421b6f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.459750 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2118241-374b-4041-90c1-7764421b6f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.461515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2118241-374b-4041-90c1-7764421b6f12 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.470814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98803664-62bd-406f-9588-5e42ca56f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.471336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 801/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:56.471691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803664-62bd-406f-9588-5e42ca56f7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.471812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803664-62bd-406f-9588-5e42ca56f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.472006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98803664-62bd-406f-9588-5e42ca56f7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.472125 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2118241-374b-4041-90c1-7764421b6f12 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.472780 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98803664-62bd-406f-9588-5e42ca56f7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.475092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98803664-62bd-406f-9588-5e42ca56f7a9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.481529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2118241-374b-4041-90c1-7764421b6f12 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.486595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d96121-cdd8-4b2c-92e8-79349bf101cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.487227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d96121-cdd8-4b2c-92e8-79349bf101cc admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.487573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d96121-cdd8-4b2c-92e8-79349bf101cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.487847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d96121-cdd8-4b2c-92e8-79349bf101cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.488567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d96121-cdd8-4b2c-92e8-79349bf101cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.490927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d96121-cdd8-4b2c-92e8-79349bf101cc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.501684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 791/1592] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.504994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98803664-62bd-406f-9588-5e42ca56f7a9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.522282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 802/1593] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.523317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d96121-cdd8-4b2c-92e8-79349bf101cc admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.563278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98803664-62bd-406f-9588-5e42ca56f7a9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.588657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d96121-cdd8-4b2c-92e8-79349bf101cc admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.594337 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b0e3d-56a1-41ec-8e3d-5d5edf9e1036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.594992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0e3d-56a1-41ec-8e3d-5d5edf9e1036 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.595267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0e3d-56a1-41ec-8e3d-5d5edf9e1036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.595533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0e3d-56a1-41ec-8e3d-5d5edf9e1036 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.596231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b0e3d-56a1-41ec-8e3d-5d5edf9e1036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.598179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b0e3d-56a1-41ec-8e3d-5d5edf9e1036 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.618567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918cc3b-c57c-42b3-bc0b-d514ac9e39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.619464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918cc3b-c57c-42b3-bc0b-d514ac9e39a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.619726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918cc3b-c57c-42b3-bc0b-d514ac9e39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.620003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918cc3b-c57c-42b3-bc0b-d514ac9e39a8 admin admin] PATH_INFO: `/v3/projects/945f13b911d24a89a9d374a503d05cbb/users/bdd86efb97ad48a994f04304a8459e54/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.631061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 803/1594] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.631873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b0e3d-56a1-41ec-8e3d-5d5edf9e1036 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.635274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918cc3b-c57c-42b3-bc0b-d514ac9e39a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945f13b911d24a89a9d374a503d05cbb, user_id=bdd86efb97ad48a994f04304a8459e54, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.637996 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918cc3b-c57c-42b3-bc0b-d514ac9e39a8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.651385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 792/1595] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:24:56 2022] PUT /identity/v3/projects/945f13b911d24a89a9d374a503d05cbb/users/bdd86efb97ad48a994f04304a8459e54/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:24:56.652157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918cc3b-c57c-42b3-bc0b-d514ac9e39a8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.696827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b0e3d-56a1-41ec-8e3d-5d5edf9e1036 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.708720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918cc3b-c57c-42b3-bc0b-d514ac9e39a8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.713437 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd686ed-9650-4ad8-ba18-fe4dc789acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.714102 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd686ed-9650-4ad8-ba18-fe4dc789acbe admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.714375 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd686ed-9650-4ad8-ba18-fe4dc789acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.714649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd686ed-9650-4ad8-ba18-fe4dc789acbe admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.715378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd686ed-9650-4ad8-ba18-fe4dc789acbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.717382 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd686ed-9650-4ad8-ba18-fe4dc789acbe admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.738749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 793/1596] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.739733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd686ed-9650-4ad8-ba18-fe4dc789acbe admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.749344 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd686ed-9650-4ad8-ba18-fe4dc789acbe admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.753967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62567b-0cf4-4f02-ad3b-b0dce04bf652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.754498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b199a-1d0e-4114-9e54-b95c162b15f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.754640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62567b-0cf4-4f02-ad3b-b0dce04bf652 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.754852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62567b-0cf4-4f02-ad3b-b0dce04bf652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.755118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62567b-0cf4-4f02-ad3b-b0dce04bf652 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.755387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b199a-1d0e-4114-9e54-b95c162b15f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.755665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b199a-1d0e-4114-9e54-b95c162b15f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.755790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62567b-0cf4-4f02-ad3b-b0dce04bf652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.755934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b199a-1d0e-4114-9e54-b95c162b15f1 admin admin] PATH_INFO: `/v3/projects/c5a4cb240dac42849a9790a68eda072a/users/3bc86d41bb2d4509913630ca774b4082/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.757685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62567b-0cf4-4f02-ad3b-b0dce04bf652 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.769864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b199a-1d0e-4114-9e54-b95c162b15f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a4cb240dac42849a9790a68eda072a, user_id=3bc86d41bb2d4509913630ca774b4082, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.772511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b199a-1d0e-4114-9e54-b95c162b15f1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.783042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 794/1597] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.783931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62567b-0cf4-4f02-ad3b-b0dce04bf652 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.786865 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 804/1598] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:24:56 2022] PUT /identity/v3/projects/c5a4cb240dac42849a9790a68eda072a/users/3bc86d41bb2d4509913630ca774b4082/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:24:56.790538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b199a-1d0e-4114-9e54-b95c162b15f1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.850014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62567b-0cf4-4f02-ad3b-b0dce04bf652 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.850644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b199a-1d0e-4114-9e54-b95c162b15f1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.855476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b494d-8bb5-40ea-a8ae-95647ff69157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.855724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c238f-8ab8-45a0-a006-ad142e380023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.856429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c238f-8ab8-45a0-a006-ad142e380023 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.856548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b494d-8bb5-40ea-a8ae-95647ff69157 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.856707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c238f-8ab8-45a0-a006-ad142e380023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.856815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b494d-8bb5-40ea-a8ae-95647ff69157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.856970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b494d-8bb5-40ea-a8ae-95647ff69157 admin admin] PATH_INFO: `/v3/projects/33608c07529f42299cd9ae077624ebdc/users/3cd1ffeab8d74519a9b0d2d202e1cf6e/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.857083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c238f-8ab8-45a0-a006-ad142e380023 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.857728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c238f-8ab8-45a0-a006-ad142e380023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.859625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c238f-8ab8-45a0-a006-ad142e380023 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.872874 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b494d-8bb5-40ea-a8ae-95647ff69157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33608c07529f42299cd9ae077624ebdc, user_id=3cd1ffeab8d74519a9b0d2d202e1cf6e, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.875896 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b494d-8bb5-40ea-a8ae-95647ff69157 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.881476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 805/1599] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.882395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c238f-8ab8-45a0-a006-ad142e380023 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.892653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c238f-8ab8-45a0-a006-ad142e380023 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.896406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 795/1600] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:24:56 2022] PUT /identity/v3/projects/33608c07529f42299cd9ae077624ebdc/users/3cd1ffeab8d74519a9b0d2d202e1cf6e/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:24:56.896406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b494d-8bb5-40ea-a8ae-95647ff69157 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.947355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c4d8a-bb5f-4123-b615-34c1a307102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.948025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c4d8a-bb5f-4123-b615-34c1a307102e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.948300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c4d8a-bb5f-4123-b615-34c1a307102e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.948566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c4d8a-bb5f-4123-b615-34c1a307102e admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.949299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c4d8a-bb5f-4123-b615-34c1a307102e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.951260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c4d8a-bb5f-4123-b615-34c1a307102e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.957103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b494d-8bb5-40ea-a8ae-95647ff69157 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:56.962519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9dd2f-2499-4ede-b43f-99f1ef6c58b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:56.963004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9dd2f-2499-4ede-b43f-99f1ef6c58b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.963324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9dd2f-2499-4ede-b43f-99f1ef6c58b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.963722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9dd2f-2499-4ede-b43f-99f1ef6c58b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.964588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9dd2f-2499-4ede-b43f-99f1ef6c58b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:56.966580 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9dd2f-2499-4ede-b43f-99f1ef6c58b5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:56.972001 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 806/1601] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.973334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abba01-3551-4803-8fc5-c8f6b360eb10 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:56.973654 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abba01-3551-4803-8fc5-c8f6b360eb10 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:56.973925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abba01-3551-4803-8fc5-c8f6b360eb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:56.987910 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 796/1602] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:56.988721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9dd2f-2499-4ede-b43f-99f1ef6c58b5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:56.992443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-67abba01-3551-4803-8fc5-c8f6b360eb10 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:56.993685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-67abba01-3551-4803-8fc5-c8f6b360eb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:56.997803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9dd2f-2499-4ede-b43f-99f1ef6c58b5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.002145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 807/1603] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:57.002274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca0036-eb68-4c30-8b27-c3011ea11065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.002778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca0036-eb68-4c30-8b27-c3011ea11065 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.002880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abba01-3551-4803-8fc5-c8f6b360eb10 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.003053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca0036-eb68-4c30-8b27-c3011ea11065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.003321 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca0036-eb68-4c30-8b27-c3011ea11065 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.004041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca0036-eb68-4c30-8b27-c3011ea11065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.006159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca0036-eb68-4c30-8b27-c3011ea11065 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.014714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abba01-3551-4803-8fc5-c8f6b360eb10 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.018582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 797/1604] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:57.018582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91692-1a4c-4923-83bb-a87ef9e6200f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.018582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91692-1a4c-4923-83bb-a87ef9e6200f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.018582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead91692-1a4c-4923-83bb-a87ef9e6200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.022531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96860528-19a0-48c4-a235-85634e7665ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.023200 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96860528-19a0-48c4-a235-85634e7665ed admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.023481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96860528-19a0-48c4-a235-85634e7665ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.023756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96860528-19a0-48c4-a235-85634e7665ed admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.024463 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96860528-19a0-48c4-a235-85634e7665ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.026491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96860528-19a0-48c4-a235-85634e7665ed admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.034846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ead91692-1a4c-4923-83bb-a87ef9e6200f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:57.035986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ead91692-1a4c-4923-83bb-a87ef9e6200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:57.044342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 798/1605] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:57.045131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead91692-1a4c-4923-83bb-a87ef9e6200f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.046829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 808/1606] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:24:57 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:57.048429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a282-42fe-48a7-b722-4b91a5151a2f None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.048527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a282-42fe-48a7-b722-4b91a5151a2f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.048770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a282-42fe-48a7-b722-4b91a5151a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.057543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead91692-1a4c-4923-83bb-a87ef9e6200f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.062211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a042a-0d4b-4f3e-a4c3-6e922a5ab0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.062898 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a042a-0d4b-4f3e-a4c3-6e922a5ab0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.063174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a042a-0d4b-4f3e-a4c3-6e922a5ab0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.063424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a042a-0d4b-4f3e-a4c3-6e922a5ab0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.064259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a042a-0d4b-4f3e-a4c3-6e922a5ab0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.065862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a042a-0d4b-4f3e-a4c3-6e922a5ab0f7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.066371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4605a282-42fe-48a7-b722-4b91a5151a2f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:57.067604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4605a282-42fe-48a7-b722-4b91a5151a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:57.075454 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 809/1607] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:57.078973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 799/1608] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:57.079126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a282-42fe-48a7-b722-4b91a5151a2f None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.079225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a042a-0d4b-4f3e-a4c3-6e922a5ab0f7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.086340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a042a-0d4b-4f3e-a4c3-6e922a5ab0f7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.090544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a282-42fe-48a7-b722-4b91a5151a2f None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.091380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9c7d0-2164-44a1-ae09-5d05fd5c77e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.092132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9c7d0-2164-44a1-ae09-5d05fd5c77e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.092472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9c7d0-2164-44a1-ae09-5d05fd5c77e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.092810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9c7d0-2164-44a1-ae09-5d05fd5c77e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.093623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9c7d0-2164-44a1-ae09-5d05fd5c77e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.095262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9c7d0-2164-44a1-ae09-5d05fd5c77e0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.095378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df93eaa-f45e-4f48-8f21-0880dc2f4d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.096026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df93eaa-f45e-4f48-8f21-0880dc2f4d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.096288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df93eaa-f45e-4f48-8f21-0880dc2f4d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.096562 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df93eaa-f45e-4f48-8f21-0880dc2f4d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.097334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df93eaa-f45e-4f48-8f21-0880dc2f4d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.098906 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df93eaa-f45e-4f48-8f21-0880dc2f4d63 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.105614 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 800/1609] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:57.106330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9c7d0-2164-44a1-ae09-5d05fd5c77e0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.109563 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 810/1610] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:57.110417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df93eaa-f45e-4f48-8f21-0880dc2f4d63 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.112079 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4df93eaa-f45e-4f48-8f21-0880dc2f4d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:57.117757 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9c7d0-2164-44a1-ae09-5d05fd5c77e0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.122213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42214bd6-f863-4afc-a7d8-b329e16c1854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.122850 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42214bd6-f863-4afc-a7d8-b329e16c1854 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.123123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42214bd6-f863-4afc-a7d8-b329e16c1854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.123388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42214bd6-f863-4afc-a7d8-b329e16c1854 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.124103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42214bd6-f863-4afc-a7d8-b329e16c1854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.125680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42214bd6-f863-4afc-a7d8-b329e16c1854 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.138867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 801/1611] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:57.138867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42214bd6-f863-4afc-a7d8-b329e16c1854 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.145475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42214bd6-f863-4afc-a7d8-b329e16c1854 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.150183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214f56-1e8b-4198-bf30-7a293e9cc9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.150807 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214f56-1e8b-4198-bf30-7a293e9cc9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.151079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214f56-1e8b-4198-bf30-7a293e9cc9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.151341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214f56-1e8b-4198-bf30-7a293e9cc9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.152038 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214f56-1e8b-4198-bf30-7a293e9cc9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.153643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214f56-1e8b-4198-bf30-7a293e9cc9a5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.166930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 802/1612] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:57.166930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214f56-1e8b-4198-bf30-7a293e9cc9a5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.167207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df93eaa-f45e-4f48-8f21-0880dc2f4d63 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.170427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a910b1-3814-4c30-b141-4d4b6e343755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.170800 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a910b1-3814-4c30-b141-4d4b6e343755 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.171079 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a910b1-3814-4c30-b141-4d4b6e343755 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.171376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a910b1-3814-4c30-b141-4d4b6e343755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.176584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214f56-1e8b-4198-bf30-7a293e9cc9a5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.180714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a910b1-3814-4c30-b141-4d4b6e343755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.180933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a18800-fb9d-4809-9b52-4139936273fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.181602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a18800-fb9d-4809-9b52-4139936273fb service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.181880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a18800-fb9d-4809-9b52-4139936273fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.182150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a18800-fb9d-4809-9b52-4139936273fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.182242 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a910b1-3814-4c30-b141-4d4b6e343755 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.191610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a18800-fb9d-4809-9b52-4139936273fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.192126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 811/1613] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:24:57.193097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a18800-fb9d-4809-9b52-4139936273fb service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.193516 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a910b1-3814-4c30-b141-4d4b6e343755 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.203164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 803/1614] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:24:57.203800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a18800-fb9d-4809-9b52-4139936273fb service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.204644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a910b1-3814-4c30-b141-4d4b6e343755 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.210288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf84f5-af3a-46af-9025-da89b6e66e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.211052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf84f5-af3a-46af-9025-da89b6e66e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.211473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf84f5-af3a-46af-9025-da89b6e66e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.211820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a18800-fb9d-4809-9b52-4139936273fb service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.211932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf84f5-af3a-46af-9025-da89b6e66e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.212778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf84f5-af3a-46af-9025-da89b6e66e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.214515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf84f5-af3a-46af-9025-da89b6e66e2b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.215755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319182-9e7f-477e-b685-1ff034b6aafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.216452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319182-9e7f-477e-b685-1ff034b6aafd service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.218081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319182-9e7f-477e-b685-1ff034b6aafd service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.218081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319182-9e7f-477e-b685-1ff034b6aafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.230309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 812/1615] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:57.230309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf84f5-af3a-46af-9025-da89b6e66e2b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.232159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e319182-9e7f-477e-b685-1ff034b6aafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.234778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e319182-9e7f-477e-b685-1ff034b6aafd service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.238828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf84f5-af3a-46af-9025-da89b6e66e2b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.244396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b15c4b-0eb3-4e05-ab93-ef2b3d2693a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.249263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b15c4b-0eb3-4e05-ab93-ef2b3d2693a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.249263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b15c4b-0eb3-4e05-ab93-ef2b3d2693a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.249263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b15c4b-0eb3-4e05-ab93-ef2b3d2693a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.249263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b15c4b-0eb3-4e05-ab93-ef2b3d2693a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.249770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 804/1616] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:24:57.249872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b15c4b-0eb3-4e05-ab93-ef2b3d2693a4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.249965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319182-9e7f-477e-b685-1ff034b6aafd service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.260047 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 813/1617] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:57.261123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319182-9e7f-477e-b685-1ff034b6aafd service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.264567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b15c4b-0eb3-4e05-ab93-ef2b3d2693a4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.271138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1926b-ca2e-476d-9c6d-ed99afad84f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.271895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1926b-ca2e-476d-9c6d-ed99afad84f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.272228 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1926b-ca2e-476d-9c6d-ed99afad84f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.272562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1926b-ca2e-476d-9c6d-ed99afad84f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.273310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1926b-ca2e-476d-9c6d-ed99afad84f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.274900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1926b-ca2e-476d-9c6d-ed99afad84f4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.275153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b15c4b-0eb3-4e05-ab93-ef2b3d2693a4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.280126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef2021-1506-4925-bd5f-d96eb283d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.281293 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef2021-1506-4925-bd5f-d96eb283d78f admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.281546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef2021-1506-4925-bd5f-d96eb283d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.281912 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef2021-1506-4925-bd5f-d96eb283d78f admin admin] PATH_INFO: `/v3/projects/88d008c52d4b4935b2286f296fc3c569/users/b092ef39391645469bcda5ef28a8e2b4/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.286416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 805/1618] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:57.287249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1926b-ca2e-476d-9c6d-ed99afad84f4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.297896 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1926b-ca2e-476d-9c6d-ed99afad84f4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.305311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329f23f-0082-4af0-97fe-0dc8352cc0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.305677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef2021-1506-4925-bd5f-d96eb283d78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d008c52d4b4935b2286f296fc3c569, user_id=b092ef39391645469bcda5ef28a8e2b4, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.306147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f23f-0082-4af0-97fe-0dc8352cc0ca admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.306373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f23f-0082-4af0-97fe-0dc8352cc0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.306641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f23f-0082-4af0-97fe-0dc8352cc0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.307471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329f23f-0082-4af0-97fe-0dc8352cc0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.309342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef2021-1506-4925-bd5f-d96eb283d78f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.310087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329f23f-0082-4af0-97fe-0dc8352cc0ca admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.328014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 806/1619] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:57.328014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329f23f-0082-4af0-97fe-0dc8352cc0ca admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.328282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 814/1620] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:24:57 2022] PUT /identity/v3/projects/88d008c52d4b4935b2286f296fc3c569/users/b092ef39391645469bcda5ef28a8e2b4/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:24:57.328282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef2021-1506-4925-bd5f-d96eb283d78f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.339353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329f23f-0082-4af0-97fe-0dc8352cc0ca admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.440932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a08893-9892-47aa-8a97-ddc4de05731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.441202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef2021-1506-4925-bd5f-d96eb283d78f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.442095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08893-9892-47aa-8a97-ddc4de05731e admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.442442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08893-9892-47aa-8a97-ddc4de05731e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.442803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08893-9892-47aa-8a97-ddc4de05731e admin admin] PATH_INFO: `/v3/projects/d7dc3b602b254dd4980bcf49dcb25224/users/72810eadeb8648c684a1ed9a1b9fcaad/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.446613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f595fd0-3596-4456-a689-111a15c89627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.447667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f595fd0-3596-4456-a689-111a15c89627 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.448081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f595fd0-3596-4456-a689-111a15c89627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.448525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f595fd0-3596-4456-a689-111a15c89627 admin admin] PATH_INFO: `/v3/projects/123522da3fec4bcdad869b206c0ef00b/users/e33675bb59ab418a87e31e1377f9aa91/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.461243 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a08893-9892-47aa-8a97-ddc4de05731e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7dc3b602b254dd4980bcf49dcb25224, user_id=72810eadeb8648c684a1ed9a1b9fcaad, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.464295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a08893-9892-47aa-8a97-ddc4de05731e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.467784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f595fd0-3596-4456-a689-111a15c89627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=123522da3fec4bcdad869b206c0ef00b, user_id=e33675bb59ab418a87e31e1377f9aa91, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.471816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f595fd0-3596-4456-a689-111a15c89627 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.484307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 807/1621] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:24:57 2022] PUT /identity/v3/projects/d7dc3b602b254dd4980bcf49dcb25224/users/72810eadeb8648c684a1ed9a1b9fcaad/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:24:57.485587 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a08893-9892-47aa-8a97-ddc4de05731e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.504367 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 815/1622] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:24:57 2022] PUT /identity/v3/projects/123522da3fec4bcdad869b206c0ef00b/users/e33675bb59ab418a87e31e1377f9aa91/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:24:57.509869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f595fd0-3596-4456-a689-111a15c89627 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:57.636877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f595fd0-3596-4456-a689-111a15c89627 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.642664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf9a51-212b-4001-bf86-c88303c3458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.643865 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf9a51-212b-4001-bf86-c88303c3458a admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.644273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf9a51-212b-4001-bf86-c88303c3458a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.644638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf9a51-212b-4001-bf86-c88303c3458a admin admin] PATH_INFO: `/v3/projects/e7dec60511594651a8d025b9cada6ddd/users/96d84b181a4848089197a9c297fb95e0/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.671531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf9a51-212b-4001-bf86-c88303c3458a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7dec60511594651a8d025b9cada6ddd, user_id=96d84b181a4848089197a9c297fb95e0, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.674597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a08893-9892-47aa-8a97-ddc4de05731e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:57.678932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf9a51-212b-4001-bf86-c88303c3458a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.688766 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1b469-3f6b-4438-ad9d-20cf3d98465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:57.689765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b469-3f6b-4438-ad9d-20cf3d98465a admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.690550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b469-3f6b-4438-ad9d-20cf3d98465a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.690830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1b469-3f6b-4438-ad9d-20cf3d98465a admin admin] PATH_INFO: `/v3/projects/5e75918ca77e4370a5219466a06ca9a6/users/0ee6fde063b34646b4ca6d477f389002/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.725350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 816/1623] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:24:57 2022] PUT /identity/v3/projects/e7dec60511594651a8d025b9cada6ddd/users/96d84b181a4848089197a9c297fb95e0/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:24:57.725350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79c51-438b-4776-9f53-4c4b3976cee2 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.725350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79c51-438b-4776-9f53-4c4b3976cee2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.725350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79c51-438b-4776-9f53-4c4b3976cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.725789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1b469-3f6b-4438-ad9d-20cf3d98465a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e75918ca77e4370a5219466a06ca9a6, user_id=0ee6fde063b34646b4ca6d477f389002, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:57.725789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1b469-3f6b-4438-ad9d-20cf3d98465a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:57.750297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 808/1624] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:24:57 2022] PUT /identity/v3/projects/5e75918ca77e4370a5219466a06ca9a6/users/0ee6fde063b34646b4ca6d477f389002/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:24:57.752011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5e0d3-30c3-48a7-8e2b-2967e924e1ba None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.752307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5e0d3-30c3-48a7-8e2b-2967e924e1ba None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.755970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5e0d3-30c3-48a7-8e2b-2967e924e1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.771642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-81f79c51-438b-4776-9f53-4c4b3976cee2 None None] MFA Rules not processed for user `b092ef39391645469bcda5ef28a8e2b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:57.774138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-81f79c51-438b-4776-9f53-4c4b3976cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:57.802904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b4d5e0d3-30c3-48a7-8e2b-2967e924e1ba None None] MFA Rules not processed for user `72810eadeb8648c684a1ed9a1b9fcaad`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:57.810835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b4d5e0d3-30c3-48a7-8e2b-2967e924e1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:57.879720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 817/1625] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:57.882096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f73bec-8374-41dc-ac10-682228016c82 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.882678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f73bec-8374-41dc-ac10-682228016c82 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.883160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f73bec-8374-41dc-ac10-682228016c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.914337 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 809/1626] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:57.915799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9fd07-f590-4b1c-b4ac-292de58ef1cf None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:57.916092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9fd07-f590-4b1c-b4ac-292de58ef1cf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:57.916362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9fd07-f590-4b1c-b4ac-292de58ef1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:57.933194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e7f73bec-8374-41dc-ac10-682228016c82 None None] MFA Rules not processed for user `e33675bb59ab418a87e31e1377f9aa91`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:57.934699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e7f73bec-8374-41dc-ac10-682228016c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:57.937885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-abd9fd07-f590-4b1c-b4ac-292de58ef1cf None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:57.939629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-abd9fd07-f590-4b1c-b4ac-292de58ef1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:58.052217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 810/1627] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:58.054001 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2671f-1dbd-466f-ad72-54172e3ddff7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.054446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2671f-1dbd-466f-ad72-54172e3ddff7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.054738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2671f-1dbd-466f-ad72-54172e3ddff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.082101 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 818/1628] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:58.083544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5d52-7a91-4e98-9efe-ca564dcff8d1 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.084167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5d52-7a91-4e98-9efe-ca564dcff8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.084303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5d52-7a91-4e98-9efe-ca564dcff8d1 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.091420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 819/1629] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jan 28 01:24:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:24:58.092843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fee5f-c8bc-421c-b5c6-30e4dc217682 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.093128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fee5f-c8bc-421c-b5c6-30e4dc217682 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.093505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fee5f-c8bc-421c-b5c6-30e4dc217682 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.094624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c6c2671f-1dbd-466f-ad72-54172e3ddff7 None None] MFA Rules not processed for user `96d84b181a4848089197a9c297fb95e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:58.095643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 820/1630] 10.222.0.16 () {54 vars in 961 bytes} [Fri Jan 28 01:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:24:58.096558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fee5f-c8bc-421c-b5c6-30e4dc217682 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:58.103078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c6c2671f-1dbd-466f-ad72-54172e3ddff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:58.180212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fee5f-c8bc-421c-b5c6-30e4dc217682 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:58.184829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a66be0-2d51-4f2e-8f5e-db08b680f8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:58.185507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a66be0-2d51-4f2e-8f5e-db08b680f8ad service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.185776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a66be0-2d51-4f2e-8f5e-db08b680f8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.186161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a66be0-2d51-4f2e-8f5e-db08b680f8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.197775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 811/1631] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:58.197775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2671f-1dbd-466f-ad72-54172e3ddff7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:58.198929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a66be0-2d51-4f2e-8f5e-db08b680f8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:58.202277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a66be0-2d51-4f2e-8f5e-db08b680f8ad service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:58.211299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2671f-1dbd-466f-ad72-54172e3ddff7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:58.216061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 821/1632] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:24:58.217575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26275c-3a80-4319-9665-d715ca5c692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:58.218046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3614fdd-03d4-4154-ab70-477affded6a2 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.218544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3614fdd-03d4-4154-ab70-477affded6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.218887 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3614fdd-03d4-4154-ab70-477affded6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.219558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26275c-3a80-4319-9665-d715ca5c692e admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.220051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26275c-3a80-4319-9665-d715ca5c692e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.220472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26275c-3a80-4319-9665-d715ca5c692e admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.221603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26275c-3a80-4319-9665-d715ca5c692e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:58.224015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26275c-3a80-4319-9665-d715ca5c692e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:58.241354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-a3614fdd-03d4-4154-ab70-477affded6a2 None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:58.243668 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a3614fdd-03d4-4154-ab70-477affded6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:58.260877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 812/1633] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:24:58 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:58.260877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89278d3b-80c2-4bef-933a-c5fe48592446 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.260877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89278d3b-80c2-4bef-933a-c5fe48592446 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.260877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89278d3b-80c2-4bef-933a-c5fe48592446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.282628 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-89278d3b-80c2-4bef-933a-c5fe48592446 None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:58.283732 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-89278d3b-80c2-4bef-933a-c5fe48592446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:58.400989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 822/1634] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jan 28 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:58.402870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3614fdd-03d4-4154-ab70-477affded6a2 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:58.418006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 813/1635] 10.222.0.16 () {58 vars in 1058 bytes} [Fri Jan 28 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:58.420521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca0c00-4058-43ee-b3f9-507bc58592a2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.421269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca0c00-4058-43ee-b3f9-507bc58592a2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.421661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca0c00-4058-43ee-b3f9-507bc58592a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.437506 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3614fdd-03d4-4154-ab70-477affded6a2 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:58.458163 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-99ca0c00-4058-43ee-b3f9-507bc58592a2 None None] MFA Rules not processed for user `bdd86efb97ad48a994f04304a8459e54`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:58.459788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-99ca0c00-4058-43ee-b3f9-507bc58592a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:58.524299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9f4f3-bab9-4f7c-ac07-eb68f225a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:58.525629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f4f3-bab9-4f7c-ac07-eb68f225a985 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.526050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f4f3-bab9-4f7c-ac07-eb68f225a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.527225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f4f3-bab9-4f7c-ac07-eb68f225a985 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.528196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9f4f3-bab9-4f7c-ac07-eb68f225a985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:58.530173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9f4f3-bab9-4f7c-ac07-eb68f225a985 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:58.574224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 823/1636] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:24:58 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:24:58.579701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9f4f3-bab9-4f7c-ac07-eb68f225a985 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:58.586407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 814/1637] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:58.588212 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca0c00-4058-43ee-b3f9-507bc58592a2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:58.611677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9f4f3-bab9-4f7c-ac07-eb68f225a985 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:58.618833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca0c00-4058-43ee-b3f9-507bc58592a2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:58.627039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681f9db-233b-458c-9097-69a1126a2cfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:58.627039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f9db-233b-458c-9097-69a1126a2cfd service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.627039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f9db-233b-458c-9097-69a1126a2cfd service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.627039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681f9db-233b-458c-9097-69a1126a2cfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.633783 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02940-960e-4318-96d6-e89fa67977b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:58.634456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02940-960e-4318-96d6-e89fa67977b7 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.634733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02940-960e-4318-96d6-e89fa67977b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.635004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02940-960e-4318-96d6-e89fa67977b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.725395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681f9db-233b-458c-9097-69a1126a2cfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:58.732764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681f9db-233b-458c-9097-69a1126a2cfd service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:58.759560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d02940-960e-4318-96d6-e89fa67977b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:58.761652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 824/1638] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:24:58.765928 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d02940-960e-4318-96d6-e89fa67977b7 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:58.768862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681f9db-233b-458c-9097-69a1126a2cfd service nova] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:58.790032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 815/1639] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:24:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:24:58.790772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681f9db-233b-458c-9097-69a1126a2cfd service nova] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:58.792336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35edda9-ece5-4a20-9ac7-56b58028d3ff None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.792740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35edda9-ece5-4a20-9ac7-56b58028d3ff None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.793057 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35edda9-ece5-4a20-9ac7-56b58028d3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.802877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2075a-e224-4308-9180-3dd367781da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:58.804173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2075a-e224-4308-9180-3dd367781da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.804173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2075a-e224-4308-9180-3dd367781da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.804377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2075a-e224-4308-9180-3dd367781da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.804958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2075a-e224-4308-9180-3dd367781da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:58.811401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2075a-e224-4308-9180-3dd367781da8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:58.812934 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a35edda9-ece5-4a20-9ac7-56b58028d3ff None None] MFA Rules not processed for user `bdd86efb97ad48a994f04304a8459e54`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:58.814695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a35edda9-ece5-4a20-9ac7-56b58028d3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:58.822979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 816/1640] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:58.830717 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 825/1641] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:58.835203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35edda9-ece5-4a20-9ac7-56b58028d3ff None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:58.848437 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35edda9-ece5-4a20-9ac7-56b58028d3ff None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:58.871188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea72362-0e6a-4b0d-aad8-5cbf9cfc8e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:58.872627 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea72362-0e6a-4b0d-aad8-5cbf9cfc8e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:58.873402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea72362-0e6a-4b0d-aad8-5cbf9cfc8e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:58.874111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea72362-0e6a-4b0d-aad8-5cbf9cfc8e65 admin admin] PATH_INFO: `/v3/projects/6115d48fcd8143559fa481a996688b65/users/66b91e25a9764c6b81291ec9bb5a2dbc/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:58.947267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea72362-0e6a-4b0d-aad8-5cbf9cfc8e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6115d48fcd8143559fa481a996688b65, user_id=66b91e25a9764c6b81291ec9bb5a2dbc, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:58.951074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea72362-0e6a-4b0d-aad8-5cbf9cfc8e65 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:58.989710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 817/1642] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:24:58 2022] PUT /identity/v3/projects/6115d48fcd8143559fa481a996688b65/users/66b91e25a9764c6b81291ec9bb5a2dbc/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:24:58.991365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2075a-e224-4308-9180-3dd367781da8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:59.009539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2075a-e224-4308-9180-3dd367781da8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:59.115999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c3777-1217-4429-86e6-243d326380fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:59.116955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c3777-1217-4429-86e6-243d326380fa admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:59.117799 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c3777-1217-4429-86e6-243d326380fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:59.118254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c3777-1217-4429-86e6-243d326380fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:59.119698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c3777-1217-4429-86e6-243d326380fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:59.121690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c3777-1217-4429-86e6-243d326380fa admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:59.143665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 826/1643] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:24:59.148238 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea72362-0e6a-4b0d-aad8-5cbf9cfc8e65 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:59.166017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea72362-0e6a-4b0d-aad8-5cbf9cfc8e65 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:59.178206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83a778-fd22-4977-a370-ca00df547459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:59.180233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83a778-fd22-4977-a370-ca00df547459 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:59.180758 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83a778-fd22-4977-a370-ca00df547459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:59.181327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83a778-fd22-4977-a370-ca00df547459 admin admin] PATH_INFO: `/v3/projects/6115d48fcd8143559fa481a996688b65/users/66b91e25a9764c6b81291ec9bb5a2dbc/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:59.184755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83a778-fd22-4977-a370-ca00df547459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6115d48fcd8143559fa481a996688b65, user_id=66b91e25a9764c6b81291ec9bb5a2dbc, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:59.189840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83a778-fd22-4977-a370-ca00df547459 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:59.206676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 818/1644] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:24:59 2022] PUT /identity/v3/projects/6115d48fcd8143559fa481a996688b65/users/66b91e25a9764c6b81291ec9bb5a2dbc/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:24:59.217459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856b393-07e9-44ca-a9f7-261e9dad17a8 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:59.218238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856b393-07e9-44ca-a9f7-261e9dad17a8 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:59.218723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856b393-07e9-44ca-a9f7-261e9dad17a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:59.266664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-0856b393-07e9-44ca-a9f7-261e9dad17a8 None None] MFA Rules not processed for user `66b91e25a9764c6b81291ec9bb5a2dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:59.268242 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0856b393-07e9-44ca-a9f7-261e9dad17a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:59.286477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c41447-cb13-490d-8e31-022af279be31 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:59.287435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c41447-cb13-490d-8e31-022af279be31 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:59.288006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c41447-cb13-490d-8e31-022af279be31 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:59.291638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 819/1645] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jan 28 01:24:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:24:59.298208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e87f3-1e6b-47b4-8a62-450fe4cada5c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:59.299096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e87f3-1e6b-47b4-8a62-450fe4cada5c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:59.299577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e87f3-1e6b-47b4-8a62-450fe4cada5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:59.328439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0b9e87f3-1e6b-47b4-8a62-450fe4cada5c None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:59.330206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0b9e87f3-1e6b-47b4-8a62-450fe4cada5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:59.423124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 827/1646] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:59.423124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a92b4-2a6a-4e95-8578-2de27d07f69e None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:59.423124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a92b4-2a6a-4e95-8578-2de27d07f69e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:59.423124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a92b4-2a6a-4e95-8578-2de27d07f69e None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:59.425959 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 828/1647] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jan 28 01:24:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:24:59.435658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852ce7-9550-48a3-b35b-5d0b08af0840 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:59.436119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852ce7-9550-48a3-b35b-5d0b08af0840 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:59.436395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852ce7-9550-48a3-b35b-5d0b08af0840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:59.457114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b3852ce7-9550-48a3-b35b-5d0b08af0840 None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:24:59.459004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b3852ce7-9550-48a3-b35b-5d0b08af0840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:24:59.465672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 820/1648] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:24:59.466550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e87f3-1e6b-47b4-8a62-450fe4cada5c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:59.482323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 829/1649] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:24:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:24:59.483462 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852ce7-9550-48a3-b35b-5d0b08af0840 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:59.556956 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e87f3-1e6b-47b4-8a62-450fe4cada5c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:59.563064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8f2b4-32bb-4384-a441-feda82e0518c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:59.563984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8f2b4-32bb-4384-a441-feda82e0518c service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:59.564334 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8f2b4-32bb-4384-a441-feda82e0518c service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:59.564677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8f2b4-32bb-4384-a441-feda82e0518c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:59.579130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8f2b4-32bb-4384-a441-feda82e0518c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:59.581519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8f2b4-32bb-4384-a441-feda82e0518c service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:59.588549 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852ce7-9550-48a3-b35b-5d0b08af0840 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:59.595189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 821/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:24:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:24:59.604036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d381a-8830-4752-a4f7-5bc472290dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:59.604913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d381a-8830-4752-a4f7-5bc472290dfb service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:59.605368 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d381a-8830-4752-a4f7-5bc472290dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:59.605730 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d381a-8830-4752-a4f7-5bc472290dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:59.632532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d381a-8830-4752-a4f7-5bc472290dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:59.634090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d381a-8830-4752-a4f7-5bc472290dfb service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:59.638311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8f2b4-32bb-4384-a441-feda82e0518c service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:24:59.651528 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 830/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:24:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:24:59.651809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8f2b4-32bb-4384-a441-feda82e0518c service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:24:59.662767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadade70-fb64-475a-a8ee-af190fe58c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:24:59.664009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadade70-fb64-475a-a8ee-af190fe58c01 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:24:59.664308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadade70-fb64-475a-a8ee-af190fe58c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:24:59.664594 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadade70-fb64-475a-a8ee-af190fe58c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:24:59.690226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadade70-fb64-475a-a8ee-af190fe58c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:24:59.692172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadade70-fb64-475a-a8ee-af190fe58c01 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:24:59.710623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 822/1652] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:24:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:00.042610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8df7-9b52-407b-a060-bf3ec6f34ecb None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:00.042610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8df7-9b52-407b-a060-bf3ec6f34ecb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:00.042915 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8df7-9b52-407b-a060-bf3ec6f34ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:00.142399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-401d8df7-9b52-407b-a060-bf3ec6f34ecb None None] MFA Rules not processed for user `0ee6fde063b34646b4ca6d477f389002`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:00.142399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-401d8df7-9b52-407b-a060-bf3ec6f34ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:00.266183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 831/1653] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:00.267343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17334-00c8-4b14-ad90-84c88b769f07 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:00.267635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17334-00c8-4b14-ad90-84c88b769f07 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:00.267911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17334-00c8-4b14-ad90-84c88b769f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:00.300242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9aa17334-00c8-4b14-ad90-84c88b769f07 None None] MFA Rules not processed for user `0ee6fde063b34646b4ca6d477f389002`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:00.302716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9aa17334-00c8-4b14-ad90-84c88b769f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:00.313400 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 823/1654] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:00.653781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8df7-9b52-407b-a060-bf3ec6f34ecb None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:00.674598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8df7-9b52-407b-a060-bf3ec6f34ecb None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:00.691690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3ccb3-14d9-40a3-a3c0-fe646a47a44e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:00.693052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3ccb3-14d9-40a3-a3c0-fe646a47a44e service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:00.695610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3ccb3-14d9-40a3-a3c0-fe646a47a44e service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:00.697068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3ccb3-14d9-40a3-a3c0-fe646a47a44e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:00.756342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa17334-00c8-4b14-ad90-84c88b769f07 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:00.769626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa17334-00c8-4b14-ad90-84c88b769f07 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:00.773678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f09e9-5b7c-437f-9095-8dd9db2b26dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:00.774522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f09e9-5b7c-437f-9095-8dd9db2b26dc service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:00.774826 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f09e9-5b7c-437f-9095-8dd9db2b26dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:00.775101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f09e9-5b7c-437f-9095-8dd9db2b26dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:00.852028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3ccb3-14d9-40a3-a3c0-fe646a47a44e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:00.854449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3ccb3-14d9-40a3-a3c0-fe646a47a44e service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:00.871256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 832/1655] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:00.897579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f09e9-5b7c-437f-9095-8dd9db2b26dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:00.900399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f09e9-5b7c-437f-9095-8dd9db2b26dc service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:00.911180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3ccb3-14d9-40a3-a3c0-fe646a47a44e service nova] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:00.916191 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 824/1656] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:00.940822 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3ccb3-14d9-40a3-a3c0-fe646a47a44e service nova] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:00.953039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1d1db-6a72-4279-8d53-ccd483ff25f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:00.954164 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d1db-6a72-4279-8d53-ccd483ff25f8 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:00.954625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d1db-6a72-4279-8d53-ccd483ff25f8 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:00.955025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1d1db-6a72-4279-8d53-ccd483ff25f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:01.078756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1d1db-6a72-4279-8d53-ccd483ff25f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:01.081467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1d1db-6a72-4279-8d53-ccd483ff25f8 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:01.100778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 833/1657] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:01.673597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f09e9-5b7c-437f-9095-8dd9db2b26dc service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:01.687272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f09e9-5b7c-437f-9095-8dd9db2b26dc service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:01.704136 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15558ec-6d9a-4787-bd9a-94ab36d35abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:01.705059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15558ec-6d9a-4787-bd9a-94ab36d35abc service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:01.705420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15558ec-6d9a-4787-bd9a-94ab36d35abc service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:01.705703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15558ec-6d9a-4787-bd9a-94ab36d35abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:01.717285 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15558ec-6d9a-4787-bd9a-94ab36d35abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:01.720244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15558ec-6d9a-4787-bd9a-94ab36d35abc service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:01.735223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 825/1658] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:02.062399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbfd4d-6a29-459d-a07b-ff7ab99be40a None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:02.064274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbfd4d-6a29-459d-a07b-ff7ab99be40a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:02.064734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbfd4d-6a29-459d-a07b-ff7ab99be40a None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:02.066932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 834/1659] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jan 28 01:25:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:25:02.073306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84cbd-e7b7-4601-8644-6035536d7fa2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:02.074365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84cbd-e7b7-4601-8644-6035536d7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:02.074795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84cbd-e7b7-4601-8644-6035536d7fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:02.201646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-58d84cbd-e7b7-4601-8644-6035536d7fa2 None None] MFA Rules not processed for user `84470027e2824dc3a4b735d086de1300`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:02.213971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-58d84cbd-e7b7-4601-8644-6035536d7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:02.322701 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 826/1660] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:02.336806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0afdd-5df0-47b2-a48f-510f01ea9e57 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:02.337192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0afdd-5df0-47b2-a48f-510f01ea9e57 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:02.337388 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0afdd-5df0-47b2-a48f-510f01ea9e57 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:02.340227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 835/1661] 10.222.0.16 () {54 vars in 912 bytes} [Fri Jan 28 01:25:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:25:02.351813 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0227-b7eb-47aa-b6d2-46887aee827f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:02.352209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0227-b7eb-47aa-b6d2-46887aee827f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:02.352571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0227-b7eb-47aa-b6d2-46887aee827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:02.365390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0afdd-5df0-47b2-a48f-510f01ea9e57 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:02.386634 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0afdd-5df0-47b2-a48f-510f01ea9e57 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:02.395028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77e1b-9204-4f25-b689-6ad99c1f179f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:02.396536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77e1b-9204-4f25-b689-6ad99c1f179f service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:02.396816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77e1b-9204-4f25-b689-6ad99c1f179f service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:02.397087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77e1b-9204-4f25-b689-6ad99c1f179f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:02.411532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-546e0227-b7eb-47aa-b6d2-46887aee827f None None] MFA Rules not processed for user `84470027e2824dc3a4b735d086de1300`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:02.415526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-546e0227-b7eb-47aa-b6d2-46887aee827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:02.433026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a77e1b-9204-4f25-b689-6ad99c1f179f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:02.442264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a77e1b-9204-4f25-b689-6ad99c1f179f service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:02.469033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 827/1662] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:02.474544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 836/1663] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:02.534258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e0227-b7eb-47aa-b6d2-46887aee827f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:02.547458 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e0227-b7eb-47aa-b6d2-46887aee827f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:02.558244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfb3c4-2700-4f7c-9e6c-6b297749d45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:02.562915 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb3c4-2700-4f7c-9e6c-6b297749d45d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:02.562915 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb3c4-2700-4f7c-9e6c-6b297749d45d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:02.562915 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb3c4-2700-4f7c-9e6c-6b297749d45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:02.591128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfb3c4-2700-4f7c-9e6c-6b297749d45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:02.597363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfb3c4-2700-4f7c-9e6c-6b297749d45d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:02.621393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 828/1664] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:03.645074 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77e1b-9204-4f25-b689-6ad99c1f179f service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:03.670479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9652d8-dda1-4266-bcf4-927b8d0b68d9 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:03.674812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9652d8-dda1-4266-bcf4-927b8d0b68d9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:03.674812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9652d8-dda1-4266-bcf4-927b8d0b68d9 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:03.674812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 829/1665] 10.222.0.16 () {54 vars in 960 bytes} [Fri Jan 28 01:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:25:03.682081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a715dd7-de98-4c8f-b030-55c2d5bcbe9c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:03.682531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a715dd7-de98-4c8f-b030-55c2d5bcbe9c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:03.683190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a715dd7-de98-4c8f-b030-55c2d5bcbe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:03.713309 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6a715dd7-de98-4c8f-b030-55c2d5bcbe9c None None] MFA Rules not processed for user `aac3e041554a4439bfa91520e52fbd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:03.714942 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6a715dd7-de98-4c8f-b030-55c2d5bcbe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:03.802559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77e1b-9204-4f25-b689-6ad99c1f179f service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:03.808507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71b444-3a8c-46cb-a38b-003570fbbbcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac3e041554a4439bfa91520e52fbd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:03.809553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b444-3a8c-46cb-a38b-003570fbbbcc service placement] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:03.810044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b444-3a8c-46cb-a38b-003570fbbbcc service placement] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:03.810913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b444-3a8c-46cb-a38b-003570fbbbcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:03.813479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-cb71b444-3a8c-46cb-a38b-003570fbbbcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:03.830008 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71b444-3a8c-46cb-a38b-003570fbbbcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:03.831917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71b444-3a8c-46cb-a38b-003570fbbbcc service placement] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:03.845686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 837/1666] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:03.933449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71b444-3a8c-46cb-a38b-003570fbbbcc service placement] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:03.934282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 830/1667] 10.222.0.16 () {58 vars in 1057 bytes} [Fri Jan 28 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:03.969113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71b444-3a8c-46cb-a38b-003570fbbbcc service placement] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:03.993767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f0535-5cbf-4e9d-bfdc-5353a202e8b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac3e041554a4439bfa91520e52fbd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:03.994834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f0535-5cbf-4e9d-bfdc-5353a202e8b9 service placement] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:03.995341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f0535-5cbf-4e9d-bfdc-5353a202e8b9 service placement] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:03.995854 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f0535-5cbf-4e9d-bfdc-5353a202e8b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:04.037540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f0535-5cbf-4e9d-bfdc-5353a202e8b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:04.042036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f0535-5cbf-4e9d-bfdc-5353a202e8b9 service placement] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:04.052297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a715dd7-de98-4c8f-b030-55c2d5bcbe9c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:04.083829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 838/1668] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:04.273070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a715dd7-de98-4c8f-b030-55c2d5bcbe9c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:04.288728 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:04.289923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:04.290206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:04.291379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] PATH_INFO: `/v3/users/e33675bb59ab418a87e31e1377f9aa91` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:04.296049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33675bb59ab418a87e31e1377f9aa91)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:04.297409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: WARNING py.warnings [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:25:04.297409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: warnings.warn(msg) Jan 28 01:25:04.297409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: Jan 28 01:25:04.298559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:04.495375 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33675bb59ab418a87e31e1377f9aa91'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:04.542733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33675bb59ab418a87e31e1377f9aa91'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:04.617094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33675bb59ab418a87e31e1377f9aa91'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:04.618446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33675bb59ab418a87e31e1377f9aa91'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:04.644168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33675bb59ab418a87e31e1377f9aa91'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:04.671377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 831/1669] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:04 2022] DELETE /identity/v3/users/e33675bb59ab418a87e31e1377f9aa91 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:04.674024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd2f15-d052-4ac9-8ae4-e4d06aa5e69e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:04.675511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd2f15-d052-4ac9-8ae4-e4d06aa5e69e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:04.676178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd2f15-d052-4ac9-8ae4-e4d06aa5e69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:04.743699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d9fd2f15-d052-4ac9-8ae4-e4d06aa5e69e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:04.745481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d9fd2f15-d052-4ac9-8ae4-e4d06aa5e69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:04.974824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 839/1670] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:05.372722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:05.375196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:05.479225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4716f-3510-47be-9a94-374fd222c1d9 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:05.479513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4716f-3510-47be-9a94-374fd222c1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:05.479787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4716f-3510-47be-9a94-374fd222c1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:05.549890 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-c3e4716f-3510-47be-9a94-374fd222c1d9 None None] MFA Rules not processed for user `3cd1ffeab8d74519a9b0d2d202e1cf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:05.555512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c3e4716f-3510-47be-9a94-374fd222c1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:05.656422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb45fa-c951-401c-b01d-bf5751977831 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:05.672846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b46b8c-493a-4f25-81e3-df9629f35710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:05.674731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b46b8c-493a-4f25-81e3-df9629f35710 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:05.675049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b46b8c-493a-4f25-81e3-df9629f35710 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:05.675322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b46b8c-493a-4f25-81e3-df9629f35710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:05.696815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b46b8c-493a-4f25-81e3-df9629f35710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:05.705865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b46b8c-493a-4f25-81e3-df9629f35710 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:05.740816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 832/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:05.857633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b46b8c-493a-4f25-81e3-df9629f35710 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:05.865468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-44b46b8c-493a-4f25-81e3-df9629f35710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:05.898740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 840/1672] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:05.903559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b46b8c-493a-4f25-81e3-df9629f35710 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:05.919779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:05.922685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:05.923308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:05.925343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] PATH_INFO: `/v3/users/96d84b181a4848089197a9c297fb95e0` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:05.927348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d84b181a4848089197a9c297fb95e0)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:05.937174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:06.056455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d84b181a4848089197a9c297fb95e0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:06.065981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d84b181a4848089197a9c297fb95e0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:06.100421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d84b181a4848089197a9c297fb95e0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:06.101890 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d84b181a4848089197a9c297fb95e0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:06.123793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d84b181a4848089197a9c297fb95e0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:06.135435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 833/1673] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:05 2022] DELETE /identity/v3/users/96d84b181a4848089197a9c297fb95e0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:06.139398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cd087-c468-4616-9d6c-3d9cc29283f9 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:06.140323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cd087-c468-4616-9d6c-3d9cc29283f9 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:06.140679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6cd087-c468-4616-9d6c-3d9cc29283f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:06.168676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-eb6cd087-c468-4616-9d6c-3d9cc29283f9 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:06.170581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-eb6cd087-c468-4616-9d6c-3d9cc29283f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:06.182708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:06.184754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:06.290027 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 841/1674] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:06.300806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cd087-c468-4616-9d6c-3d9cc29283f9 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:06.302799 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-eb6cd087-c468-4616-9d6c-3d9cc29283f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:06.345107 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb82a81-7b0e-4f67-a678-f749804eecbd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:06.352710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02297716-6571-40a2-8870-76bb815e788a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:06.353440 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02297716-6571-40a2-8870-76bb815e788a service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:06.353723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02297716-6571-40a2-8870-76bb815e788a service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:06.353992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02297716-6571-40a2-8870-76bb815e788a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:06.358659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-02297716-6571-40a2-8870-76bb815e788a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:06.461633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6cd087-c468-4616-9d6c-3d9cc29283f9 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:06.467004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1384a8-b913-419e-805f-119932260384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:06.467819 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1384a8-b913-419e-805f-119932260384 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:06.468162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1384a8-b913-419e-805f-119932260384 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:06.468769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1384a8-b913-419e-805f-119932260384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:06.469992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02297716-6571-40a2-8870-76bb815e788a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:06.472478 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02297716-6571-40a2-8870-76bb815e788a service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:06.493172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 834/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:06.513611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1384a8-b913-419e-805f-119932260384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:06.515451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1384a8-b913-419e-805f-119932260384 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:06.538364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 842/1676] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:06.592563 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02297716-6571-40a2-8870-76bb815e788a service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:06.595104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-02297716-6571-40a2-8870-76bb815e788a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:06.661776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02297716-6571-40a2-8870-76bb815e788a service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:06.688707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:06.691886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:06.693938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:06.694554 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] PATH_INFO: `/v3/users/72810eadeb8648c684a1ed9a1b9fcaad` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:06.701920 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72810eadeb8648c684a1ed9a1b9fcaad)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:06.717070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:06.860299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72810eadeb8648c684a1ed9a1b9fcaad'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:06.875233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72810eadeb8648c684a1ed9a1b9fcaad'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:06.894706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72810eadeb8648c684a1ed9a1b9fcaad'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:06.896192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72810eadeb8648c684a1ed9a1b9fcaad'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:06.914976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72810eadeb8648c684a1ed9a1b9fcaad'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:06.943151 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 835/1677] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:06 2022] DELETE /identity/v3/users/72810eadeb8648c684a1ed9a1b9fcaad => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:06.946081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf76bb-0c45-484b-a63d-eb719d82a6e7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:06.946647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf76bb-0c45-484b-a63d-eb719d82a6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:06.946877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf76bb-0c45-484b-a63d-eb719d82a6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:06.995360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-6daf76bb-0c45-484b-a63d-eb719d82a6e7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:07.002050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6daf76bb-0c45-484b-a63d-eb719d82a6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:07.122559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:07.124533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:07.142977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 843/1678] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:07.250770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf76bb-0c45-484b-a63d-eb719d82a6e7 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:07.253731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6daf76bb-0c45-484b-a63d-eb719d82a6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:07.387401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf76bb-0c45-484b-a63d-eb719d82a6e7 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:07.404503 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b11c47-4498-4633-a258-721908593178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:07.405701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b11c47-4498-4633-a258-721908593178 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:07.406224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b11c47-4498-4633-a258-721908593178 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:07.406732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b11c47-4498-4633-a258-721908593178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:07.412485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c60b30-e329-44e7-8728-fc09d202bd06 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:07.433447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:07.433724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b11c47-4498-4633-a258-721908593178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:07.434408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:07.434856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:07.435090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b11c47-4498-4633-a258-721908593178 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:07.435449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] PATH_INFO: `/v3/projects/123522da3fec4bcdad869b206c0ef00b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:07.438965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=123522da3fec4bcdad869b206c0ef00b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:07.441321 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:07.463713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 844/1679] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:07.526296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b11c47-4498-4633-a258-721908593178 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:07.528610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e3b11c47-4498-4633-a258-721908593178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:07.560576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b11c47-4498-4633-a258-721908593178 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:07.575862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '123522da3fec4bcdad869b206c0ef00b', 'request_id': 'req-760b49c8-beee-4424-9993-041bf491f6c4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:07.598094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '123522da3fec4bcdad869b206c0ef00b', 'request_id': 'req-760b49c8-beee-4424-9993-041bf491f6c4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:07.613663 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '123522da3fec4bcdad869b206c0ef00b', 'request_id': 'req-760b49c8-beee-4424-9993-041bf491f6c4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:07.662016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] The token cache is being invalidate because project 123522da3fec4bcdad869b206c0ef00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:07.662288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:07.662987 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:07.668383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 836/1680] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:07 2022] DELETE /identity/v3/projects/123522da3fec4bcdad869b206c0ef00b => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:07.680204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:07.681874 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:07.747476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:07.749147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:07.749667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:07.750104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] PATH_INFO: `/v3/projects/e7dec60511594651a8d025b9cada6ddd` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:07.759977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7dec60511594651a8d025b9cada6ddd)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:07.762188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: WARNING py.warnings [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:25:07.762188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: warnings.warn(msg) Jan 28 01:25:07.762188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: Jan 28 01:25:07.766917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:07.816939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b49c8-beee-4424-9993-041bf491f6c4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:07.833638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:07.834963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:07.835248 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:07.835522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] PATH_INFO: `/v3/users/66b91e25a9764c6b81291ec9bb5a2dbc` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:07.839776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b91e25a9764c6b81291ec9bb5a2dbc)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:07.844612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:08.003225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7dec60511594651a8d025b9cada6ddd', 'request_id': 'req-03ba6676-833e-488a-8864-318b8743e287'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.012950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b91e25a9764c6b81291ec9bb5a2dbc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.035742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b91e25a9764c6b81291ec9bb5a2dbc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.048621 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7dec60511594651a8d025b9cada6ddd', 'request_id': 'req-03ba6676-833e-488a-8864-318b8743e287'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.056339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7dec60511594651a8d025b9cada6ddd', 'request_id': 'req-03ba6676-833e-488a-8864-318b8743e287'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.074319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b91e25a9764c6b81291ec9bb5a2dbc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.075998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b91e25a9764c6b81291ec9bb5a2dbc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.090985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] The token cache is being invalidate because project e7dec60511594651a8d025b9cada6ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:08.091133 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.091887 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2fbb1c00-c5e3-4609-9664-0fef47c94bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b91e25a9764c6b81291ec9bb5a2dbc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.092016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03ba6676-833e-488a-8864-318b8743e287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.093584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 845/1681] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:07 2022] DELETE /identity/v3/projects/e7dec60511594651a8d025b9cada6ddd => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:08.100735 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580f6b9-b2c7-455d-9cd7-c505f62a5e5e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:08.101278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580f6b9-b2c7-455d-9cd7-c505f62a5e5e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:08.101607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580f6b9-b2c7-455d-9cd7-c505f62a5e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:08.108979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 837/1682] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:07 2022] DELETE /identity/v3/users/66b91e25a9764c6b81291ec9bb5a2dbc => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:08.112233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb6ec8-6527-4402-9151-00e40ba1d5fd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:08.113523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb6ec8-6527-4402-9151-00e40ba1d5fd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:08.114852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb6ec8-6527-4402-9151-00e40ba1d5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:08.161008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-53bb6ec8-6527-4402-9151-00e40ba1d5fd None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:08.163904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-53bb6ec8-6527-4402-9151-00e40ba1d5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:08.190709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4580f6b9-b2c7-455d-9cd7-c505f62a5e5e None None] MFA Rules not processed for user `3bc86d41bb2d4509913630ca774b4082`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:08.195278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4580f6b9-b2c7-455d-9cd7-c505f62a5e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:08.380621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 838/1683] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:08.381780 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb6ec8-6527-4402-9151-00e40ba1d5fd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:08.383453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-53bb6ec8-6527-4402-9151-00e40ba1d5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:08.391559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 846/1684] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:08.392995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cde1b8-eada-480f-a214-be5f0b09bc2a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:08.393328 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cde1b8-eada-480f-a214-be5f0b09bc2a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:08.393663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cde1b8-eada-480f-a214-be5f0b09bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:08.417085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb6ec8-6527-4402-9151-00e40ba1d5fd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:08.417552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-16cde1b8-eada-480f-a214-be5f0b09bc2a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:08.419487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-16cde1b8-eada-480f-a214-be5f0b09bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:08.426671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:08.427573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:08.428005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:08.428556 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] PATH_INFO: `/v3/projects/d7dc3b602b254dd4980bcf49dcb25224` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:08.432361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7dc3b602b254dd4980bcf49dcb25224)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:08.435408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:08.452401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 847/1685] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:08.457052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd7b12-5eba-4d6c-9643-45d1559876d7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:08.460057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd7b12-5eba-4d6c-9643-45d1559876d7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:08.460331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd7b12-5eba-4d6c-9643-45d1559876d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:08.508053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d6dd7b12-5eba-4d6c-9643-45d1559876d7 None None] MFA Rules not processed for user `3bc86d41bb2d4509913630ca774b4082`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:08.510780 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d6dd7b12-5eba-4d6c-9643-45d1559876d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:08.522776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7dc3b602b254dd4980bcf49dcb25224', 'request_id': 'req-bcafb01a-e515-47dc-ab79-b48683146644'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.540104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7dc3b602b254dd4980bcf49dcb25224', 'request_id': 'req-bcafb01a-e515-47dc-ab79-b48683146644'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.552530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7dc3b602b254dd4980bcf49dcb25224', 'request_id': 'req-bcafb01a-e515-47dc-ab79-b48683146644'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.569672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] The token cache is being invalidate because project d7dc3b602b254dd4980bcf49dcb25224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:08.573255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.574232 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:08.580859 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 839/1686] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:08 2022] DELETE /identity/v3/projects/d7dc3b602b254dd4980bcf49dcb25224 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:08.582020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:08.592852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:08.618136 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 848/1687] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:08.620065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ae778-4cb7-4788-91c4-da2efeb3fd35 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:08.620426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ae778-4cb7-4788-91c4-da2efeb3fd35 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:08.621202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ae778-4cb7-4788-91c4-da2efeb3fd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:08.656180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ab5ae778-4cb7-4788-91c4-da2efeb3fd35 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:08.657876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ab5ae778-4cb7-4788-91c4-da2efeb3fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:08.786472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafb01a-e515-47dc-ab79-b48683146644 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:08.807722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f69173-1a29-4138-90cd-553a8fa3e9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:08.808492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f69173-1a29-4138-90cd-553a8fa3e9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:08.808773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f69173-1a29-4138-90cd-553a8fa3e9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:08.809067 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f69173-1a29-4138-90cd-553a8fa3e9a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:08.809981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f69173-1a29-4138-90cd-553a8fa3e9a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:25:08.810292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f69173-1a29-4138-90cd-553a8fa3e9a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:08.815725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f69173-1a29-4138-90cd-553a8fa3e9a2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:08.843414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 840/1688] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:25:08.847184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f69173-1a29-4138-90cd-553a8fa3e9a2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:08.850871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-39f69173-1a29-4138-90cd-553a8fa3e9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:08.877167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 849/1689] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:08.879789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ae778-4cb7-4788-91c4-da2efeb3fd35 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:08.920145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ae778-4cb7-4788-91c4-da2efeb3fd35 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:08.940862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3e295-fd54-425a-9371-72594d5a6c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:08.941929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3e295-fd54-425a-9371-72594d5a6c1e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:08.943807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3e295-fd54-425a-9371-72594d5a6c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:08.944333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3e295-fd54-425a-9371-72594d5a6c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:08.948158 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3e295-fd54-425a-9371-72594d5a6c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:08.956151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3e295-fd54-425a-9371-72594d5a6c1e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:09.025965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f69173-1a29-4138-90cd-553a8fa3e9a2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:09.035473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d4926-267f-43e2-a421-607d6b7a6cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:09.036487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d4926-267f-43e2-a421-607d6b7a6cf1 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.037088 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d4926-267f-43e2-a421-607d6b7a6cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.037761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d4926-267f-43e2-a421-607d6b7a6cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.040390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8b4d4926-267f-43e2-a421-607d6b7a6cf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:09.058716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d4926-267f-43e2-a421-607d6b7a6cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:09.063555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d4926-267f-43e2-a421-607d6b7a6cf1 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:09.067269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 850/1690] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:08 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:09.070401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3e295-fd54-425a-9371-72594d5a6c1e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:09.119047 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-03d3e295-fd54-425a-9371-72594d5a6c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:09.122892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 841/1691] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:09.122892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861aca94-80f0-4ede-9b46-b46ba2ed3913 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.122892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861aca94-80f0-4ede-9b46-b46ba2ed3913 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.122892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861aca94-80f0-4ede-9b46-b46ba2ed3913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.172888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-861aca94-80f0-4ede-9b46-b46ba2ed3913 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:09.174293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-861aca94-80f0-4ede-9b46-b46ba2ed3913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:09.271163 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3e295-fd54-425a-9371-72594d5a6c1e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:09.279858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:09.281103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.281605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.282047 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] PATH_INFO: `/v3/projects/6115d48fcd8143559fa481a996688b65` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.283878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6115d48fcd8143559fa481a996688b65)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:09.286842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:09.379087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6115d48fcd8143559fa481a996688b65', 'request_id': 'req-4a905a84-3db5-4975-9230-0a2dca764123'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:09.396060 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6115d48fcd8143559fa481a996688b65', 'request_id': 'req-4a905a84-3db5-4975-9230-0a2dca764123'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:09.401094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 842/1692] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:09.402402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861aca94-80f0-4ede-9b46-b46ba2ed3913 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:09.416205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861aca94-80f0-4ede-9b46-b46ba2ed3913 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:09.423021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6115d48fcd8143559fa481a996688b65', 'request_id': 'req-4a905a84-3db5-4975-9230-0a2dca764123'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:09.458810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] The token cache is being invalidate because project 6115d48fcd8143559fa481a996688b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:09.460746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:09.464250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:09.467969 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 851/1693] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:09 2022] DELETE /identity/v3/projects/6115d48fcd8143559fa481a996688b65 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:09.469935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:09.473682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:09.510717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eaed1-c3e1-495a-a8df-9080329ad315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:09.512138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eaed1-c3e1-495a-a8df-9080329ad315 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.512638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eaed1-c3e1-495a-a8df-9080329ad315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.513060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eaed1-c3e1-495a-a8df-9080329ad315 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.513996 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eaed1-c3e1-495a-a8df-9080329ad315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:09.516178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eaed1-c3e1-495a-a8df-9080329ad315 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:09.565027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 843/1694] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:09 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:09.566626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb08016-f9ba-48db-b6ac-ce7cce5612d8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.566936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb08016-f9ba-48db-b6ac-ce7cce5612d8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.567194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb08016-f9ba-48db-b6ac-ce7cce5612d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.622363 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905a84-3db5-4975-9230-0a2dca764123 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:09.628981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94b1c-ba8e-428e-b237-495fb69179a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:09.629977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94b1c-ba8e-428e-b237-495fb69179a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.630359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94b1c-ba8e-428e-b237-495fb69179a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.630778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed94b1c-ba8e-428e-b237-495fb69179a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.632010 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94b1c-ba8e-428e-b237-495fb69179a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:25:09.632154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94b1c-ba8e-428e-b237-495fb69179a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:09.634079 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed94b1c-ba8e-428e-b237-495fb69179a1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:09.653539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 852/1695] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:25:09.654855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94b1c-ba8e-428e-b237-495fb69179a1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:09.657885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-fed94b1c-ba8e-428e-b237-495fb69179a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:09.666592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8bb08016-f9ba-48db-b6ac-ce7cce5612d8 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:09.668373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8bb08016-f9ba-48db-b6ac-ce7cce5612d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:09.675744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed94b1c-ba8e-428e-b237-495fb69179a1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:09.683333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfe8b2-33fc-474d-bad6-c7548785f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:09.684329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfe8b2-33fc-474d-bad6-c7548785f84b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.684827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfe8b2-33fc-474d-bad6-c7548785f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.685358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfe8b2-33fc-474d-bad6-c7548785f84b admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.686733 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfe8b2-33fc-474d-bad6-c7548785f84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:09.689208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfe8b2-33fc-474d-bad6-c7548785f84b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:09.696212 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 844/1696] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:09.697399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb08016-f9ba-48db-b6ac-ce7cce5612d8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:09.713193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 853/1697] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:09.715271 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07330500-6f04-4d31-9efb-b23b6e81ec0e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.715710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07330500-6f04-4d31-9efb-b23b6e81ec0e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.716077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07330500-6f04-4d31-9efb-b23b6e81ec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.716178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb08016-f9ba-48db-b6ac-ce7cce5612d8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:09.743908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-07330500-6f04-4d31-9efb-b23b6e81ec0e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:09.745397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-07330500-6f04-4d31-9efb-b23b6e81ec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:09.760593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 854/1698] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:09.760593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07330500-6f04-4d31-9efb-b23b6e81ec0e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:09.762642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049eb1e-3337-4e72-aa92-56bdb0596924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:09.764308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049eb1e-3337-4e72-aa92-56bdb0596924 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.764797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049eb1e-3337-4e72-aa92-56bdb0596924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.765357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049eb1e-3337-4e72-aa92-56bdb0596924 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.766287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049eb1e-3337-4e72-aa92-56bdb0596924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:09.777335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049eb1e-3337-4e72-aa92-56bdb0596924 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:09.781887 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07330500-6f04-4d31-9efb-b23b6e81ec0e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:09.796885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7150c70-12e7-49a2-94d6-f4521572a572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:09.799773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7150c70-12e7-49a2-94d6-f4521572a572 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.800066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7150c70-12e7-49a2-94d6-f4521572a572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.800348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7150c70-12e7-49a2-94d6-f4521572a572 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.803744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7150c70-12e7-49a2-94d6-f4521572a572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:09.808361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7150c70-12e7-49a2-94d6-f4521572a572 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:09.823480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 845/1699] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:09 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:09.826007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049eb1e-3337-4e72-aa92-56bdb0596924 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:09.854956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 855/1700] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:09.857773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7150c70-12e7-49a2-94d6-f4521572a572 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:09.890658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7150c70-12e7-49a2-94d6-f4521572a572 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:09.979336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049eb1e-3337-4e72-aa92-56bdb0596924 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:09.991267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91543f-7610-404e-a3c7-b478d3a78754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:09.993164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91543f-7610-404e-a3c7-b478d3a78754 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:09.993467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91543f-7610-404e-a3c7-b478d3a78754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:09.993735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91543f-7610-404e-a3c7-b478d3a78754 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:09.994520 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91543f-7610-404e-a3c7-b478d3a78754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:25:09.994827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91543f-7610-404e-a3c7-b478d3a78754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:09.996511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91543f-7610-404e-a3c7-b478d3a78754 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:10.017923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef662298-21aa-4a6b-85e3-44ed9f9295a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:10.019039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef662298-21aa-4a6b-85e3-44ed9f9295a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.019456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef662298-21aa-4a6b-85e3-44ed9f9295a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.019832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef662298-21aa-4a6b-85e3-44ed9f9295a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.020674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef662298-21aa-4a6b-85e3-44ed9f9295a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:10.023026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef662298-21aa-4a6b-85e3-44ed9f9295a1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:10.036433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 846/1701] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:25:10.036626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91543f-7610-404e-a3c7-b478d3a78754 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:10.059629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 856/1702] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:09 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:10.061064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef662298-21aa-4a6b-85e3-44ed9f9295a1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:10.075783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef662298-21aa-4a6b-85e3-44ed9f9295a1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:10.080206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91543f-7610-404e-a3c7-b478d3a78754 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:10.083827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ad38-3003-4a0d-8f09-00d5efed33cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:10.085033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ad38-3003-4a0d-8f09-00d5efed33cd admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.085564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ad38-3003-4a0d-8f09-00d5efed33cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.085943 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2ad38-3003-4a0d-8f09-00d5efed33cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.086787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2ad38-3003-4a0d-8f09-00d5efed33cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:10.090327 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2ad38-3003-4a0d-8f09-00d5efed33cd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:10.109611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c9e82-b2f0-457c-a0ed-262c76fa6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:10.110886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c9e82-b2f0-457c-a0ed-262c76fa6a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.111424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c9e82-b2f0-457c-a0ed-262c76fa6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.112234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c9e82-b2f0-457c-a0ed-262c76fa6a3e admin admin] PATH_INFO: `/v3/projects/f0b0ad8e7afc4658921e59c94a9c6d2b/users/04bd619a0423408c8f0aab9dbe2df347/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.148073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 857/1703] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:10 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:10.148073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ad38-3003-4a0d-8f09-00d5efed33cd admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:10.201893 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c9e82-b2f0-457c-a0ed-262c76fa6a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b0ad8e7afc4658921e59c94a9c6d2b, user_id=04bd619a0423408c8f0aab9dbe2df347, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:10.204649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c9e82-b2f0-457c-a0ed-262c76fa6a3e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:10.245218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2ad38-3003-4a0d-8f09-00d5efed33cd admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:10.255227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 847/1704] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:10 2022] PUT /identity/v3/projects/f0b0ad8e7afc4658921e59c94a9c6d2b/users/04bd619a0423408c8f0aab9dbe2df347/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:10.261861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c9e82-b2f0-457c-a0ed-262c76fa6a3e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:10.376263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c9e82-b2f0-457c-a0ed-262c76fa6a3e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:10.399093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ffc7a-9134-4830-a253-c7ae20a256c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:10.405069 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ffc7a-9134-4830-a253-c7ae20a256c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.408175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ffc7a-9134-4830-a253-c7ae20a256c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.408483 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ffc7a-9134-4830-a253-c7ae20a256c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.409270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ffc7a-9134-4830-a253-c7ae20a256c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:10.426337 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ffc7a-9134-4830-a253-c7ae20a256c9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:10.463501 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5488ad-51bc-4a1b-8aee-36e57d968510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:10.465416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5488ad-51bc-4a1b-8aee-36e57d968510 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.465807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5488ad-51bc-4a1b-8aee-36e57d968510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.468087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5488ad-51bc-4a1b-8aee-36e57d968510 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.470112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5488ad-51bc-4a1b-8aee-36e57d968510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:10.474318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5488ad-51bc-4a1b-8aee-36e57d968510 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:10.488706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 848/1705] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:10 2022] POST /identity/v3/users => generated 287 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:10.490786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66aaba-feee-4728-b556-f29563704c5f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.491227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66aaba-feee-4728-b556-f29563704c5f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.491663 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66aaba-feee-4728-b556-f29563704c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.501282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 858/1706] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:10.502196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5488ad-51bc-4a1b-8aee-36e57d968510 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:10.524096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5488ad-51bc-4a1b-8aee-36e57d968510 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:10.552141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b426db-dc64-4a80-9572-cdca1a98f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:10.552928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b426db-dc64-4a80-9572-cdca1a98f805 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.553213 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b426db-dc64-4a80-9572-cdca1a98f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.553572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b426db-dc64-4a80-9572-cdca1a98f805 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.555183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b426db-dc64-4a80-9572-cdca1a98f805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:10.563679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b426db-dc64-4a80-9572-cdca1a98f805 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:10.595961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 859/1707] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:10.600101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-bd66aaba-feee-4728-b556-f29563704c5f None None] MFA Rules not processed for user `04bd619a0423408c8f0aab9dbe2df347`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:10.602414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bd66aaba-feee-4728-b556-f29563704c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:10.602869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b426db-dc64-4a80-9572-cdca1a98f805 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:10.632125 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b426db-dc64-4a80-9572-cdca1a98f805 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:10.650684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310df67c-52fe-4065-84df-8ee7ecd3e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:10.651433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310df67c-52fe-4065-84df-8ee7ecd3e1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.651754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310df67c-52fe-4065-84df-8ee7ecd3e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.652035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310df67c-52fe-4065-84df-8ee7ecd3e1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.652793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310df67c-52fe-4065-84df-8ee7ecd3e1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:10.656580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310df67c-52fe-4065-84df-8ee7ecd3e1a3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:10.695084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 860/1708] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:10.696504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310df67c-52fe-4065-84df-8ee7ecd3e1a3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:10.741810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310df67c-52fe-4065-84df-8ee7ecd3e1a3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:10.764498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff51160-5f72-42e8-97f2-e8b62e645419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:10.764498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff51160-5f72-42e8-97f2-e8b62e645419 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.764888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff51160-5f72-42e8-97f2-e8b62e645419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.765050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff51160-5f72-42e8-97f2-e8b62e645419 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.765866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff51160-5f72-42e8-97f2-e8b62e645419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:10.770588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff51160-5f72-42e8-97f2-e8b62e645419 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:10.800646 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 861/1709] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:10.802902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff51160-5f72-42e8-97f2-e8b62e645419 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:10.861309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff51160-5f72-42e8-97f2-e8b62e645419 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:10.866907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 849/1710] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:10.872214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66aaba-feee-4728-b556-f29563704c5f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:10.907437 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66aaba-feee-4728-b556-f29563704c5f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:10.910606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee46d3-f736-4088-b404-7bccab751d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:10.911773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee46d3-f736-4088-b404-7bccab751d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.912051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee46d3-f736-4088-b404-7bccab751d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.912328 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee46d3-f736-4088-b404-7bccab751d83 admin admin] PATH_INFO: `/v3/projects/5d734a9e2d9a4841bbfe59fd893eb53a/users/a0241bdb7d574680a5a92a8ed8c7d29f/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.929894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952095a-adcd-4ce0-afa9-8b2cd175db1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:10.931872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952095a-adcd-4ce0-afa9-8b2cd175db1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:10.933476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952095a-adcd-4ce0-afa9-8b2cd175db1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:10.933950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952095a-adcd-4ce0-afa9-8b2cd175db1e admin admin] PATH_INFO: `/v3/projects/992f508ada3d41b0a0022ca24be349f6/users/f3653669c96843c3b6edd44b541fee00/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:10.951586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee46d3-f736-4088-b404-7bccab751d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d734a9e2d9a4841bbfe59fd893eb53a, user_id=a0241bdb7d574680a5a92a8ed8c7d29f, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:10.955401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee46d3-f736-4088-b404-7bccab751d83 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:10.987396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952095a-adcd-4ce0-afa9-8b2cd175db1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=992f508ada3d41b0a0022ca24be349f6, user_id=f3653669c96843c3b6edd44b541fee00, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:10.989374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 862/1711] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:10 2022] PUT /identity/v3/projects/5d734a9e2d9a4841bbfe59fd893eb53a/users/a0241bdb7d574680a5a92a8ed8c7d29f/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:10.990605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee46d3-f736-4088-b404-7bccab751d83 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:10.996136 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952095a-adcd-4ce0-afa9-8b2cd175db1e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:11.048147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 850/1712] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:10 2022] PUT /identity/v3/projects/992f508ada3d41b0a0022ca24be349f6/users/f3653669c96843c3b6edd44b541fee00/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:11.059172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42389e-3964-4f90-a17b-28dba69e1f4c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:11.059481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42389e-3964-4f90-a17b-28dba69e1f4c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:11.059734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42389e-3964-4f90-a17b-28dba69e1f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:11.165927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7e42389e-3964-4f90-a17b-28dba69e1f4c None None] MFA Rules not processed for user `a0241bdb7d574680a5a92a8ed8c7d29f`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:11.167332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7e42389e-3964-4f90-a17b-28dba69e1f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:11.196279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee46d3-f736-4088-b404-7bccab751d83 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:11.281135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628e241-5def-4f25-9dc8-6d7b6effe091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:11.284239 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628e241-5def-4f25-9dc8-6d7b6effe091 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:11.284522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628e241-5def-4f25-9dc8-6d7b6effe091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:11.285442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628e241-5def-4f25-9dc8-6d7b6effe091 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:11.290387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628e241-5def-4f25-9dc8-6d7b6effe091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:11.296559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628e241-5def-4f25-9dc8-6d7b6effe091 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:11.313004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 851/1713] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:11.324028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6d534-801c-4957-9d14-6f347cf57189 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:11.324441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6d534-801c-4957-9d14-6f347cf57189 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:11.324624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6d534-801c-4957-9d14-6f347cf57189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:11.370825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8aa6d534-801c-4957-9d14-6f347cf57189 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:11.372118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8aa6d534-801c-4957-9d14-6f347cf57189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:11.383942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 863/1714] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:10 2022] POST /identity/v3/projects => generated 373 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:11.387963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628e241-5def-4f25-9dc8-6d7b6effe091 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:11.391494 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 852/1715] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:11.392822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e972d9d-391b-41c2-8520-1689a4bdeea3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:11.393116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e972d9d-391b-41c2-8520-1689a4bdeea3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:11.393422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e972d9d-391b-41c2-8520-1689a4bdeea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:11.430897 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2e972d9d-391b-41c2-8520-1689a4bdeea3 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:11.434356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2e972d9d-391b-41c2-8520-1689a4bdeea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:11.539206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 853/1716] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:11.540520 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e972d9d-391b-41c2-8520-1689a4bdeea3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:11.570132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628e241-5def-4f25-9dc8-6d7b6effe091 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:11.587658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33762ea-79a4-48a3-821a-69090e538368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:11.588345 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33762ea-79a4-48a3-821a-69090e538368 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:11.588779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33762ea-79a4-48a3-821a-69090e538368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:11.589060 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33762ea-79a4-48a3-821a-69090e538368 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:11.590649 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33762ea-79a4-48a3-821a-69090e538368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:11.593082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33762ea-79a4-48a3-821a-69090e538368 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:11.678249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 864/1717] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:11 2022] POST /identity/v3/projects => generated 405 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:11.678249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33762ea-79a4-48a3-821a-69090e538368 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:11.684640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d33762ea-79a4-48a3-821a-69090e538368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:11.766561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e972d9d-391b-41c2-8520-1689a4bdeea3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:11.835547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33762ea-79a4-48a3-821a-69090e538368 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:11.847020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb81e56-5abd-45f7-99ed-12c9c2f6edc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:11.847698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb81e56-5abd-45f7-99ed-12c9c2f6edc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:11.847978 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb81e56-5abd-45f7-99ed-12c9c2f6edc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:11.848253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb81e56-5abd-45f7-99ed-12c9c2f6edc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:11.962181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e9286-94a8-4617-adc9-278c722b2993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:11.963038 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e9286-94a8-4617-adc9-278c722b2993 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:11.963450 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e9286-94a8-4617-adc9-278c722b2993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:11.963897 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e9286-94a8-4617-adc9-278c722b2993 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:11.964964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e9286-94a8-4617-adc9-278c722b2993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:11.968738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e9286-94a8-4617-adc9-278c722b2993 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:11.997454 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 854/1718] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:11 2022] POST /identity/v3/users => generated 293 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:11.998289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e9286-94a8-4617-adc9-278c722b2993 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:12.015614 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e9286-94a8-4617-adc9-278c722b2993 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:12.021933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a12f4-4e2d-44d9-b3ba-9438222b9cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:12.022752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a12f4-4e2d-44d9-b3ba-9438222b9cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:12.023128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a12f4-4e2d-44d9-b3ba-9438222b9cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:12.028195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a12f4-4e2d-44d9-b3ba-9438222b9cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:12.037931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb81e56-5abd-45f7-99ed-12c9c2f6edc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:12.044656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a12f4-4e2d-44d9-b3ba-9438222b9cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:12.053817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a12f4-4e2d-44d9-b3ba-9438222b9cb9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:12.069872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb81e56-5abd-45f7-99ed-12c9c2f6edc6 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:12.095135 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 855/1719] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:11 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:12.096004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a12f4-4e2d-44d9-b3ba-9438222b9cb9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:12.100240 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e60a12f4-4e2d-44d9-b3ba-9438222b9cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:12.118803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 865/1720] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:12.121140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c52ee-ad90-421e-aed5-f212e8821846 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:12.122926 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c52ee-ad90-421e-aed5-f212e8821846 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:12.123882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c52ee-ad90-421e-aed5-f212e8821846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:12.177694 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9e9c52ee-ad90-421e-aed5-f212e8821846 None None] MFA Rules not processed for user `3cd1ffeab8d74519a9b0d2d202e1cf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:12.180903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9e9c52ee-ad90-421e-aed5-f212e8821846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:12.226943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a12f4-4e2d-44d9-b3ba-9438222b9cb9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:12.270744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 866/1721] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:12.271543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c52ee-ad90-421e-aed5-f212e8821846 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:12.284427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96a22-e05b-427a-a55d-aff48e029b30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:12.285099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96a22-e05b-427a-a55d-aff48e029b30 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:12.288101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96a22-e05b-427a-a55d-aff48e029b30 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:12.288551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f96a22-e05b-427a-a55d-aff48e029b30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:12.294153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c52ee-ad90-421e-aed5-f212e8821846 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:12.322350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39829cf7-087d-40ba-9082-45daf1eaa329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:12.326379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39829cf7-087d-40ba-9082-45daf1eaa329 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:12.326734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39829cf7-087d-40ba-9082-45daf1eaa329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:12.327077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39829cf7-087d-40ba-9082-45daf1eaa329 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:12.328469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39829cf7-087d-40ba-9082-45daf1eaa329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:12.330324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39829cf7-087d-40ba-9082-45daf1eaa329 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:12.354576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 867/1722] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:12.354576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39829cf7-087d-40ba-9082-45daf1eaa329 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:12.381988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39829cf7-087d-40ba-9082-45daf1eaa329 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:12.401545 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3f363-aac9-40ca-bdb4-e89fcdadbaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:12.402300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3f363-aac9-40ca-bdb4-e89fcdadbaaa admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:12.402580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3f363-aac9-40ca-bdb4-e89fcdadbaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:12.402918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3f363-aac9-40ca-bdb4-e89fcdadbaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:12.403673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3f363-aac9-40ca-bdb4-e89fcdadbaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:12.405959 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3f363-aac9-40ca-bdb4-e89fcdadbaaa admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:12.439327 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 868/1723] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:12.441820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7afab-d75b-4a61-aa54-d00dab2b9528 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:12.442272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7afab-d75b-4a61-aa54-d00dab2b9528 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:12.442934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7afab-d75b-4a61-aa54-d00dab2b9528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:12.469656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f96a22-e05b-427a-a55d-aff48e029b30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:12.474983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f96a22-e05b-427a-a55d-aff48e029b30 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:12.502117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-17a7afab-d75b-4a61-aa54-d00dab2b9528 None None] MFA Rules not processed for user `3bc86d41bb2d4509913630ca774b4082`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:12.503541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 856/1724] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:25:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:25:12.503803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-17a7afab-d75b-4a61-aa54-d00dab2b9528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:12.509688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96a22-e05b-427a-a55d-aff48e029b30 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:12.547900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f96a22-e05b-427a-a55d-aff48e029b30 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:12.585678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5afd0-13fb-40df-afc3-94aba08bb577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:12.589160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5afd0-13fb-40df-afc3-94aba08bb577 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:12.589673 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5afd0-13fb-40df-afc3-94aba08bb577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:12.590101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5afd0-13fb-40df-afc3-94aba08bb577 admin admin] PATH_INFO: `/v3/projects/36537646071d4cd3b4309820b34920d4/users/9618a3116ccd47f7952b7dc2aafb74dc/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:12.636229 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5afd0-13fb-40df-afc3-94aba08bb577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36537646071d4cd3b4309820b34920d4, user_id=9618a3116ccd47f7952b7dc2aafb74dc, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:12.640042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5afd0-13fb-40df-afc3-94aba08bb577 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:12.670198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 857/1725] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:12 2022] PUT /identity/v3/projects/36537646071d4cd3b4309820b34920d4/users/9618a3116ccd47f7952b7dc2aafb74dc/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:12.671812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5afd0-13fb-40df-afc3-94aba08bb577 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:12.763800 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 869/1726] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:12.767928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7afab-d75b-4a61-aa54-d00dab2b9528 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:12.822710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7afab-d75b-4a61-aa54-d00dab2b9528 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:13.010388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5afd0-13fb-40df-afc3-94aba08bb577 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:13.035676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc35f1d-4b13-4053-b056-7746ae1caa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:13.040056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc35f1d-4b13-4053-b056-7746ae1caa64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:13.040362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc35f1d-4b13-4053-b056-7746ae1caa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:13.044382 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc35f1d-4b13-4053-b056-7746ae1caa64 admin admin] PATH_INFO: `/v3/projects/163cbf59ab444140983dfd835acd515b/users/3f716885a1f94a86a113f374432cf825/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:13.103497 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48bd30-1546-4927-8102-1a48fc52ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:13.107539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48bd30-1546-4927-8102-1a48fc52ca07 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:13.109183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48bd30-1546-4927-8102-1a48fc52ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:13.109528 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48bd30-1546-4927-8102-1a48fc52ca07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:13.112805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48bd30-1546-4927-8102-1a48fc52ca07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:13.118041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48bd30-1546-4927-8102-1a48fc52ca07 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:13.123311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc35f1d-4b13-4053-b056-7746ae1caa64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=163cbf59ab444140983dfd835acd515b, user_id=3f716885a1f94a86a113f374432cf825, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:13.132028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc35f1d-4b13-4053-b056-7746ae1caa64 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:13.167540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 870/1727] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:13.172654 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48bd30-1546-4927-8102-1a48fc52ca07 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:13.188176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 858/1728] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:12 2022] PUT /identity/v3/projects/163cbf59ab444140983dfd835acd515b/users/3f716885a1f94a86a113f374432cf825/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:13.190275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc35f1d-4b13-4053-b056-7746ae1caa64 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:13.212216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48bd30-1546-4927-8102-1a48fc52ca07 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:13.499994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acd0fd-ff0c-49d9-8c9f-7a54e0687ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:13.505124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acd0fd-ff0c-49d9-8c9f-7a54e0687ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:13.506149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acd0fd-ff0c-49d9-8c9f-7a54e0687ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:13.506403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acd0fd-ff0c-49d9-8c9f-7a54e0687ef7 admin admin] PATH_INFO: `/v3/projects/36537646071d4cd3b4309820b34920d4/users/9618a3116ccd47f7952b7dc2aafb74dc/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:13.508952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc35f1d-4b13-4053-b056-7746ae1caa64 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:13.513370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acd0fd-ff0c-49d9-8c9f-7a54e0687ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36537646071d4cd3b4309820b34920d4, user_id=9618a3116ccd47f7952b7dc2aafb74dc, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:13.519753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acd0fd-ff0c-49d9-8c9f-7a54e0687ef7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:13.530677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02961251-33bb-4caa-adf1-76e2cde9529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:13.533357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02961251-33bb-4caa-adf1-76e2cde9529e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:13.534152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02961251-33bb-4caa-adf1-76e2cde9529e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:13.535074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02961251-33bb-4caa-adf1-76e2cde9529e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:13.536735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02961251-33bb-4caa-adf1-76e2cde9529e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:13.540467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02961251-33bb-4caa-adf1-76e2cde9529e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:13.580948 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 871/1729] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:13 2022] PUT /identity/v3/projects/36537646071d4cd3b4309820b34920d4/users/9618a3116ccd47f7952b7dc2aafb74dc/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:13.596313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b346989-2ca5-49b5-a955-e7b8907e1f6c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:13.597090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b346989-2ca5-49b5-a955-e7b8907e1f6c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:13.597863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b346989-2ca5-49b5-a955-e7b8907e1f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:13.601533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 859/1730] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:13.604251 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02961251-33bb-4caa-adf1-76e2cde9529e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:13.678986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02961251-33bb-4caa-adf1-76e2cde9529e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:13.744387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-7b346989-2ca5-49b5-a955-e7b8907e1f6c None None] MFA Rules not processed for user `9618a3116ccd47f7952b7dc2aafb74dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:13.754020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7b346989-2ca5-49b5-a955-e7b8907e1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:13.949391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26322970-7926-490f-9ece-0f2cf70e04ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:13.969286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322970-7926-490f-9ece-0f2cf70e04ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:13.973354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322970-7926-490f-9ece-0f2cf70e04ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:13.978529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322970-7926-490f-9ece-0f2cf70e04ad admin admin] PATH_INFO: `/v3/projects/163cbf59ab444140983dfd835acd515b/users/3f716885a1f94a86a113f374432cf825/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:13.995671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26322970-7926-490f-9ece-0f2cf70e04ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=163cbf59ab444140983dfd835acd515b, user_id=3f716885a1f94a86a113f374432cf825, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:14.003600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26322970-7926-490f-9ece-0f2cf70e04ad admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:14.020018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 872/1731] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:14.031799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 860/1732] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:13 2022] PUT /identity/v3/projects/163cbf59ab444140983dfd835acd515b/users/3f716885a1f94a86a113f374432cf825/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:14.043778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b346989-2ca5-49b5-a955-e7b8907e1f6c None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:14.044696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef8246-2178-48e3-a641-c58a9b7c28d5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:14.045125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef8246-2178-48e3-a641-c58a9b7c28d5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:14.045255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7b346989-2ca5-49b5-a955-e7b8907e1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:14.045654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef8246-2178-48e3-a641-c58a9b7c28d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:14.099079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-26ef8246-2178-48e3-a641-c58a9b7c28d5 None None] MFA Rules not processed for user `3f716885a1f94a86a113f374432cf825`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:14.102369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-26ef8246-2178-48e3-a641-c58a9b7c28d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:14.193972 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b346989-2ca5-49b5-a955-e7b8907e1f6c None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:14.286972 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 861/1733] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:14.288518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef8246-2178-48e3-a641-c58a9b7c28d5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:14.290333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-26ef8246-2178-48e3-a641-c58a9b7c28d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:14.290988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2047c35-da2b-4a78-9b86-987302042eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:14.294721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047c35-da2b-4a78-9b86-987302042eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:14.295082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047c35-da2b-4a78-9b86-987302042eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:14.295375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047c35-da2b-4a78-9b86-987302042eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:14.305715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef8246-2178-48e3-a641-c58a9b7c28d5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:14.310509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e086f-9254-41fb-a899-f3a6bacb5204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:14.311419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e086f-9254-41fb-a899-f3a6bacb5204 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:14.313579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e086f-9254-41fb-a899-f3a6bacb5204 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:14.314122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e086f-9254-41fb-a899-f3a6bacb5204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:14.336535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e086f-9254-41fb-a899-f3a6bacb5204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:14.339509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e086f-9254-41fb-a899-f3a6bacb5204 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:14.372190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 862/1734] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:14 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:14.448841 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2047c35-da2b-4a78-9b86-987302042eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:14.454353 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2047c35-da2b-4a78-9b86-987302042eb7 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:14.473543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 873/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:14.742538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e086f-9254-41fb-a899-f3a6bacb5204 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:14.769773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e086f-9254-41fb-a899-f3a6bacb5204 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:14.818283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867df72-e532-4c1e-97f7-54bbdb0c79f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:14.819049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867df72-e532-4c1e-97f7-54bbdb0c79f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:14.819689 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867df72-e532-4c1e-97f7-54bbdb0c79f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:14.823718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867df72-e532-4c1e-97f7-54bbdb0c79f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:15.010267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2047c35-da2b-4a78-9b86-987302042eb7 service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:15.124368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867df72-e532-4c1e-97f7-54bbdb0c79f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:15.129345 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867df72-e532-4c1e-97f7-54bbdb0c79f7 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:15.147301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 863/1736] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:15.174969 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2047c35-da2b-4a78-9b86-987302042eb7 service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:15.182533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:15.184032 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:15.184570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:15.185378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] PATH_INFO: `/v3/users/a0241bdb7d574680a5a92a8ed8c7d29f` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:15.187303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0241bdb7d574680a5a92a8ed8c7d29f)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:15.191561 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:15.340378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0241bdb7d574680a5a92a8ed8c7d29f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:15.364533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0241bdb7d574680a5a92a8ed8c7d29f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:15.365846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0241bdb7d574680a5a92a8ed8c7d29f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:15.386105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0241bdb7d574680a5a92a8ed8c7d29f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:15.422863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0241bdb7d574680a5a92a8ed8c7d29f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:15.464005 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 874/1737] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:15 2022] DELETE /identity/v3/users/a0241bdb7d574680a5a92a8ed8c7d29f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:15.470796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24678ed6-7c83-4aaa-b310-e9482ffaad34 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:15.471881 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24678ed6-7c83-4aaa-b310-e9482ffaad34 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:15.471881 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24678ed6-7c83-4aaa-b310-e9482ffaad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:15.550453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-24678ed6-7c83-4aaa-b310-e9482ffaad34 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:15.554930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-24678ed6-7c83-4aaa-b310-e9482ffaad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:15.780981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 864/1738] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:15.799652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:15.802294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:15.915053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c35bc-ac23-4c29-bf27-abbc1c9f7a55 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:15.919339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669a125-efd4-41ea-9888-bff1bb3d988c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:15.920098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669a125-efd4-41ea-9888-bff1bb3d988c service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:15.920453 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669a125-efd4-41ea-9888-bff1bb3d988c service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:15.920805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669a125-efd4-41ea-9888-bff1bb3d988c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:15.932350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669a125-efd4-41ea-9888-bff1bb3d988c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:15.934129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669a125-efd4-41ea-9888-bff1bb3d988c service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:15.945609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 875/1739] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:16.452889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24678ed6-7c83-4aaa-b310-e9482ffaad34 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:16.455000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-24678ed6-7c83-4aaa-b310-e9482ffaad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:16.489946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24678ed6-7c83-4aaa-b310-e9482ffaad34 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:16.503211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:16.504090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:16.504370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:16.504643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] PATH_INFO: `/v3/projects/5d734a9e2d9a4841bbfe59fd893eb53a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:16.506136 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d734a9e2d9a4841bbfe59fd893eb53a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:16.507937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:16.695605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d734a9e2d9a4841bbfe59fd893eb53a', 'request_id': 'req-b3d65fa8-9822-456b-93bf-68463403b851'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:16.728802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d734a9e2d9a4841bbfe59fd893eb53a', 'request_id': 'req-b3d65fa8-9822-456b-93bf-68463403b851'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:16.743470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d734a9e2d9a4841bbfe59fd893eb53a', 'request_id': 'req-b3d65fa8-9822-456b-93bf-68463403b851'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:16.782303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] The token cache is being invalidate because project 5d734a9e2d9a4841bbfe59fd893eb53a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:16.784373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:16.785594 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b3d65fa8-9822-456b-93bf-68463403b851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:16.800493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 865/1740] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:16 2022] DELETE /identity/v3/projects/5d734a9e2d9a4841bbfe59fd893eb53a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:16.803476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669a125-efd4-41ea-9888-bff1bb3d988c service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:16.821412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669a125-efd4-41ea-9888-bff1bb3d988c service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:16.956290 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a0c8e-c7c8-474c-91bd-09d6b756517c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:16.956915 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a0c8e-c7c8-474c-91bd-09d6b756517c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:16.957356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a0c8e-c7c8-474c-91bd-09d6b756517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:17.042257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:17.043724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:17.044103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:17.044470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] PATH_INFO: `/v3/users/3f716885a1f94a86a113f374432cf825` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:17.045973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f716885a1f94a86a113f374432cf825)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:17.048055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:17.116458 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-027a0c8e-c7c8-474c-91bd-09d6b756517c None None] MFA Rules not processed for user `f3653669c96843c3b6edd44b541fee00`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:17.130027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-027a0c8e-c7c8-474c-91bd-09d6b756517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:17.230475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f716885a1f94a86a113f374432cf825'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:17.251757 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f716885a1f94a86a113f374432cf825'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:17.255718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f716885a1f94a86a113f374432cf825'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:17.273112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f716885a1f94a86a113f374432cf825'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:17.323351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e4d83782-bb10-4f9a-9fe2-40304b100052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f716885a1f94a86a113f374432cf825'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:17.378373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 876/1741] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:16 2022] DELETE /identity/v3/users/3f716885a1f94a86a113f374432cf825 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:17.395311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a31ff-d907-4b30-8009-dfa3f7f0d758 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:17.400432 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a31ff-d907-4b30-8009-dfa3f7f0d758 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:17.404329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a31ff-d907-4b30-8009-dfa3f7f0d758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:17.507947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-c08a31ff-d907-4b30-8009-dfa3f7f0d758 None None] MFA Rules not processed for user `84470027e2824dc3a4b735d086de1300`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:17.514530 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c08a31ff-d907-4b30-8009-dfa3f7f0d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:17.525699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 866/1742] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 575 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:17.531184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a0c8e-c7c8-474c-91bd-09d6b756517c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:17.536263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-027a0c8e-c7c8-474c-91bd-09d6b756517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:17.586270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a0c8e-c7c8-474c-91bd-09d6b756517c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:17.724486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 877/1743] 10.222.0.88 () {58 vars in 1015 bytes} [Fri Jan 28 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:17.855672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a31ff-d907-4b30-8009-dfa3f7f0d758 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:17.860985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c08a31ff-d907-4b30-8009-dfa3f7f0d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:17.869158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4cfbb-282d-46bb-bb99-b4f89a726784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:17.873654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4cfbb-282d-46bb-bb99-b4f89a726784 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:17.874104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4cfbb-282d-46bb-bb99-b4f89a726784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:17.874529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4cfbb-282d-46bb-bb99-b4f89a726784 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:17.876521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4cfbb-282d-46bb-bb99-b4f89a726784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:17.880441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4cfbb-282d-46bb-bb99-b4f89a726784 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:17.893707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a31ff-d907-4b30-8009-dfa3f7f0d758 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:17.935397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f5e29-2026-4630-b86e-465f3d2b2fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:17.936095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5e29-2026-4630-b86e-465f3d2b2fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:17.946960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5e29-2026-4630-b86e-465f3d2b2fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:17.947273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5e29-2026-4630-b86e-465f3d2b2fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:17.998798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f5e29-2026-4630-b86e-465f3d2b2fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:18.002960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f5e29-2026-4630-b86e-465f3d2b2fa5 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:18.032445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 867/1744] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:17 2022] POST /identity/v3/projects => generated 369 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:18.036251 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4cfbb-282d-46bb-bb99-b4f89a726784 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:18.042831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 878/1745] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:18.044006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f5e29-2026-4630-b86e-465f3d2b2fa5 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:18.103073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f5e29-2026-4630-b86e-465f3d2b2fa5 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:18.242223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e8ea6-8be6-44a2-b40e-5687f1bc0d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:18.246138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e8ea6-8be6-44a2-b40e-5687f1bc0d5e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:18.246850 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e8ea6-8be6-44a2-b40e-5687f1bc0d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:18.247314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e8ea6-8be6-44a2-b40e-5687f1bc0d5e admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:18.250061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e8ea6-8be6-44a2-b40e-5687f1bc0d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:18.255319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e8ea6-8be6-44a2-b40e-5687f1bc0d5e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:18.310121 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 879/1746] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:18 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:18.313843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e8ea6-8be6-44a2-b40e-5687f1bc0d5e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:18.364760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4cfbb-282d-46bb-bb99-b4f89a726784 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:18.366211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e8ea6-8be6-44a2-b40e-5687f1bc0d5e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:18.383182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72bb0e-31e7-425b-bc5f-55c0edcde374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:18.384129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72bb0e-31e7-425b-bc5f-55c0edcde374 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:18.385654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72bb0e-31e7-425b-bc5f-55c0edcde374 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:18.386158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72bb0e-31e7-425b-bc5f-55c0edcde374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:18.405695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472eedd0-ad07-4e11-abac-4121395f2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:18.407144 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72bb0e-31e7-425b-bc5f-55c0edcde374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:18.409051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72bb0e-31e7-425b-bc5f-55c0edcde374 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:18.410644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eedd0-ad07-4e11-abac-4121395f2533 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:18.411992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eedd0-ad07-4e11-abac-4121395f2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:18.414594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eedd0-ad07-4e11-abac-4121395f2533 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:18.416913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472eedd0-ad07-4e11-abac-4121395f2533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:18.426347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472eedd0-ad07-4e11-abac-4121395f2533 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:18.433003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 868/1747] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:18.437133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72bb0e-31e7-425b-bc5f-55c0edcde374 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:18.439552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6b72bb0e-31e7-425b-bc5f-55c0edcde374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:18.488195 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 880/1748] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:25:18.494659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472eedd0-ad07-4e11-abac-4121395f2533 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:18.494937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72bb0e-31e7-425b-bc5f-55c0edcde374 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:18.523476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:18.524619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:18.524859 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:18.525464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] PATH_INFO: `/v3/projects/163cbf59ab444140983dfd835acd515b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:18.534205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163cbf59ab444140983dfd835acd515b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:18.537267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:18.538046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472eedd0-ad07-4e11-abac-4121395f2533 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:18.548404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e0044-8885-489d-849d-3b14bc816267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:18.549695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e0044-8885-489d-849d-3b14bc816267 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:18.550073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e0044-8885-489d-849d-3b14bc816267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:18.550440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e0044-8885-489d-849d-3b14bc816267 admin admin] PATH_INFO: `/v3/projects/6fdb64f5377e4a72aa4f9fd11f1d1734/users/7fd3428820c341ff9665152c17192b6f/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:18.602963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e0044-8885-489d-849d-3b14bc816267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdb64f5377e4a72aa4f9fd11f1d1734, user_id=7fd3428820c341ff9665152c17192b6f, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:18.609603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e0044-8885-489d-849d-3b14bc816267 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:18.644710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 881/1749] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:18 2022] PUT /identity/v3/projects/6fdb64f5377e4a72aa4f9fd11f1d1734/users/7fd3428820c341ff9665152c17192b6f/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:18.649485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e0044-8885-489d-849d-3b14bc816267 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:18.704925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163cbf59ab444140983dfd835acd515b', 'request_id': 'req-40fe756b-3180-4c9f-b319-b73c3d705e34'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:18.723383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163cbf59ab444140983dfd835acd515b', 'request_id': 'req-40fe756b-3180-4c9f-b319-b73c3d705e34'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:18.735474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163cbf59ab444140983dfd835acd515b', 'request_id': 'req-40fe756b-3180-4c9f-b319-b73c3d705e34'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:18.756824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] The token cache is being invalidate because project 163cbf59ab444140983dfd835acd515b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:18.757181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:18.762040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-40fe756b-3180-4c9f-b319-b73c3d705e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:18.765271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 869/1750] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:18 2022] DELETE /identity/v3/projects/163cbf59ab444140983dfd835acd515b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:18.771867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5721ea-11e2-4c2f-b2ac-cb874d4725b1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:18.772153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5721ea-11e2-4c2f-b2ac-cb874d4725b1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:18.772431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5721ea-11e2-4c2f-b2ac-cb874d4725b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:18.817911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2f5721ea-11e2-4c2f-b2ac-cb874d4725b1 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:18.819303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2f5721ea-11e2-4c2f-b2ac-cb874d4725b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:18.825083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e0044-8885-489d-849d-3b14bc816267 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:18.941371 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 870/1751] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:18.943185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d3a5-94a1-4ea5-afe1-b46fd3a83392 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:18.943473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d3a5-94a1-4ea5-afe1-b46fd3a83392 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:18.943767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3d3a5-94a1-4ea5-afe1-b46fd3a83392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:18.980612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-afe3d3a5-94a1-4ea5-afe1-b46fd3a83392 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:18.982257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-afe3d3a5-94a1-4ea5-afe1-b46fd3a83392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:19.007723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 871/1752] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:19.008945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3d3a5-94a1-4ea5-afe1-b46fd3a83392 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:19.036054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3d3a5-94a1-4ea5-afe1-b46fd3a83392 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:19.047435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de163b30-1cbc-4878-8a5b-2d33e4234bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:19.048110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de163b30-1cbc-4878-8a5b-2d33e4234bce admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:19.050596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de163b30-1cbc-4878-8a5b-2d33e4234bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:19.050886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de163b30-1cbc-4878-8a5b-2d33e4234bce admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:19.051680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de163b30-1cbc-4878-8a5b-2d33e4234bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:25:19.051936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de163b30-1cbc-4878-8a5b-2d33e4234bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:19.056756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06877e-0cdd-4cd6-b205-e2a06b09f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:19.058037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06877e-0cdd-4cd6-b205-e2a06b09f06e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:19.058469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06877e-0cdd-4cd6-b205-e2a06b09f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:19.058974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06877e-0cdd-4cd6-b205-e2a06b09f06e admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:19.060840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06877e-0cdd-4cd6-b205-e2a06b09f06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:19.063692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de163b30-1cbc-4878-8a5b-2d33e4234bce admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:19.064403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06877e-0cdd-4cd6-b205-e2a06b09f06e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:19.086187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 872/1753] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:25:19.088138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de163b30-1cbc-4878-8a5b-2d33e4234bce admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:19.093611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 882/1754] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:19.094944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06877e-0cdd-4cd6-b205-e2a06b09f06e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:19.099486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3b06877e-0cdd-4cd6-b205-e2a06b09f06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:19.113697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de163b30-1cbc-4878-8a5b-2d33e4234bce admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:19.121615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70bc66-b072-4c1b-9e3d-ee50bfe30e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:19.122715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70bc66-b072-4c1b-9e3d-ee50bfe30e3d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:19.122995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70bc66-b072-4c1b-9e3d-ee50bfe30e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:19.123336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70bc66-b072-4c1b-9e3d-ee50bfe30e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:19.126033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70bc66-b072-4c1b-9e3d-ee50bfe30e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:19.129369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70bc66-b072-4c1b-9e3d-ee50bfe30e3d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:19.151291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06877e-0cdd-4cd6-b205-e2a06b09f06e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:19.157594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb9961-23ec-4967-a07c-62a58412e392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:19.158828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9961-23ec-4967-a07c-62a58412e392 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:19.159295 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9961-23ec-4967-a07c-62a58412e392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:19.159762 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb9961-23ec-4967-a07c-62a58412e392 admin admin] PATH_INFO: `/v3/projects/6fdb64f5377e4a72aa4f9fd11f1d1734/users/7fd3428820c341ff9665152c17192b6f/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:19.163403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb9961-23ec-4967-a07c-62a58412e392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdb64f5377e4a72aa4f9fd11f1d1734, user_id=7fd3428820c341ff9665152c17192b6f, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:19.167216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb9961-23ec-4967-a07c-62a58412e392 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:19.212100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 883/1755] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:19 2022] PUT /identity/v3/projects/6fdb64f5377e4a72aa4f9fd11f1d1734/users/7fd3428820c341ff9665152c17192b6f/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:19.214151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb9961-23ec-4967-a07c-62a58412e392 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:19.222503 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c5eb9961-23ec-4967-a07c-62a58412e392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:19.236766 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 873/1756] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:19 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:19.261665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70bc66-b072-4c1b-9e3d-ee50bfe30e3d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:19.410817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb9961-23ec-4967-a07c-62a58412e392 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:19.423147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:19.425058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:19.425193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:19.425720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] PATH_INFO: `/v3/users/b092ef39391645469bcda5ef28a8e2b4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:19.427931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70bc66-b072-4c1b-9e3d-ee50bfe30e3d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:19.432366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b092ef39391645469bcda5ef28a8e2b4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:19.443933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:19.453007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a5be2-79d7-46d0-9306-61a4c69216cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:19.453743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a5be2-79d7-46d0-9306-61a4c69216cf admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:19.454030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a5be2-79d7-46d0-9306-61a4c69216cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:19.454453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a5be2-79d7-46d0-9306-61a4c69216cf admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:19.455246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a5be2-79d7-46d0-9306-61a4c69216cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:19.457113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a5be2-79d7-46d0-9306-61a4c69216cf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:19.507724 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 874/1757] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:19 2022] POST /identity/v3/users => generated 283 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:19.513743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a5be2-79d7-46d0-9306-61a4c69216cf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:19.542851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a5be2-79d7-46d0-9306-61a4c69216cf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:19.554614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b092ef39391645469bcda5ef28a8e2b4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:19.557187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43c8dc-6a72-4378-9c86-cac52f83ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:19.559154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c8dc-6a72-4378-9c86-cac52f83ea79 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:19.559457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c8dc-6a72-4378-9c86-cac52f83ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:19.559714 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43c8dc-6a72-4378-9c86-cac52f83ea79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:19.561905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43c8dc-6a72-4378-9c86-cac52f83ea79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:19.566185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43c8dc-6a72-4378-9c86-cac52f83ea79 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:19.571813 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b092ef39391645469bcda5ef28a8e2b4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:19.574675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b092ef39391645469bcda5ef28a8e2b4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:19.590670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b092ef39391645469bcda5ef28a8e2b4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:19.595768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 875/1758] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:19.601636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43c8dc-6a72-4378-9c86-cac52f83ea79 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:19.618405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8032c76e-5dce-499a-bd3a-ba425fc2571b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b092ef39391645469bcda5ef28a8e2b4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:19.628075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43c8dc-6a72-4378-9c86-cac52f83ea79 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:19.636427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 884/1759] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:19 2022] DELETE /identity/v3/users/b092ef39391645469bcda5ef28a8e2b4 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:19.641604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa027-5cf7-42c7-8400-0731fb92c0cf None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:19.641604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa027-5cf7-42c7-8400-0731fb92c0cf None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:19.641846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fa027-5cf7-42c7-8400-0731fb92c0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:19.654090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca6332-ffda-4be7-b6f9-4e480aeead2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:19.654789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca6332-ffda-4be7-b6f9-4e480aeead2f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:19.655159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca6332-ffda-4be7-b6f9-4e480aeead2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:19.655428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca6332-ffda-4be7-b6f9-4e480aeead2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:19.656185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca6332-ffda-4be7-b6f9-4e480aeead2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:19.657839 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca6332-ffda-4be7-b6f9-4e480aeead2f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:19.705656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 876/1760] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:19.706648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca6332-ffda-4be7-b6f9-4e480aeead2f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:19.708155 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e90fa027-5cf7-42c7-8400-0731fb92c0cf None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:19.710151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e90fa027-5cf7-42c7-8400-0731fb92c0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:19.712782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-abca6332-ffda-4be7-b6f9-4e480aeead2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:19.750815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca6332-ffda-4be7-b6f9-4e480aeead2f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:19.867517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 885/1761] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:19.879177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fa027-5cf7-42c7-8400-0731fb92c0cf None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:19.882472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e90fa027-5cf7-42c7-8400-0731fb92c0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:19.962826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fa027-5cf7-42c7-8400-0731fb92c0cf None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:19.971312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f619463-4c6d-4e6d-99b5-006312bd34f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:19.975820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f619463-4c6d-4e6d-99b5-006312bd34f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:19.976286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f619463-4c6d-4e6d-99b5-006312bd34f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:19.976889 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f619463-4c6d-4e6d-99b5-006312bd34f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:20.007338 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f619463-4c6d-4e6d-99b5-006312bd34f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:20.011045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f619463-4c6d-4e6d-99b5-006312bd34f2 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:20.011546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b056be-e96f-4704-96e7-136e0da98479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:20.012502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b056be-e96f-4704-96e7-136e0da98479 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:20.012781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b056be-e96f-4704-96e7-136e0da98479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:20.013057 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b056be-e96f-4704-96e7-136e0da98479 admin admin] PATH_INFO: `/v3/projects/4f95da5ee65c4b3cbac71978d2c492e6/users/10b842d2ca5f47c4b6098a3a0bda4d89/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:20.036306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 886/1762] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:20.059473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b056be-e96f-4704-96e7-136e0da98479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f95da5ee65c4b3cbac71978d2c492e6, user_id=10b842d2ca5f47c4b6098a3a0bda4d89, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:20.070649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b056be-e96f-4704-96e7-136e0da98479 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:20.084680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 877/1763] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:19 2022] PUT /identity/v3/projects/4f95da5ee65c4b3cbac71978d2c492e6/users/10b842d2ca5f47c4b6098a3a0bda4d89/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:20.099393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd9233-5e4c-431f-bd8b-75f0b68ed95e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:20.100044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd9233-5e4c-431f-bd8b-75f0b68ed95e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:20.100044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd9233-5e4c-431f-bd8b-75f0b68ed95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:20.147666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-0fbd9233-5e4c-431f-bd8b-75f0b68ed95e None None] MFA Rules not processed for user `10b842d2ca5f47c4b6098a3a0bda4d89`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:20.149197 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0fbd9233-5e4c-431f-bd8b-75f0b68ed95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:20.331299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 887/1764] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:20.332166 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b056be-e96f-4704-96e7-136e0da98479 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:20.483399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b056be-e96f-4704-96e7-136e0da98479 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:20.499539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc93955-a4c7-4534-89e5-908c10c37b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:20.500227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc93955-a4c7-4534-89e5-908c10c37b14 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:20.500506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc93955-a4c7-4534-89e5-908c10c37b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:20.500775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc93955-a4c7-4534-89e5-908c10c37b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:20.501748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc93955-a4c7-4534-89e5-908c10c37b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:20.503737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc93955-a4c7-4534-89e5-908c10c37b14 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:20.593432 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 878/1765] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:20 2022] POST /identity/v3/projects => generated 363 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:20.595819 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd9233-5e4c-431f-bd8b-75f0b68ed95e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:20.608359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd9233-5e4c-431f-bd8b-75f0b68ed95e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:20.685193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dccd6f-7117-4819-8ee8-e554ec2fa7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:20.686102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dccd6f-7117-4819-8ee8-e554ec2fa7ce admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:20.686380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dccd6f-7117-4819-8ee8-e554ec2fa7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:20.686647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dccd6f-7117-4819-8ee8-e554ec2fa7ce admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:20.687357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dccd6f-7117-4819-8ee8-e554ec2fa7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:20.689498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dccd6f-7117-4819-8ee8-e554ec2fa7ce admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:20.722149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 888/1766] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:20 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:20.723519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc93955-a4c7-4534-89e5-908c10c37b14 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:20.737324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc93955-a4c7-4534-89e5-908c10c37b14 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:20.741955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4435-4ffd-47f4-9cb5-5470b4494c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:20.743027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4435-4ffd-47f4-9cb5-5470b4494c9a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:20.743027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4435-4ffd-47f4-9cb5-5470b4494c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:20.743275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4435-4ffd-47f4-9cb5-5470b4494c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:20.746799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc4435-4ffd-47f4-9cb5-5470b4494c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:20.746799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc4435-4ffd-47f4-9cb5-5470b4494c9a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:20.758945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 879/1767] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:25:20.762842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dccd6f-7117-4819-8ee8-e554ec2fa7ce admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:20.775911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dccd6f-7117-4819-8ee8-e554ec2fa7ce admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:20.781693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08b596-7c8b-4a51-ac54-b7fbebb5327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:20.783324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08b596-7c8b-4a51-ac54-b7fbebb5327d admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:20.783324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08b596-7c8b-4a51-ac54-b7fbebb5327d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:20.783324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08b596-7c8b-4a51-ac54-b7fbebb5327d admin admin] PATH_INFO: `/v3/projects/be0b207ef29e4cbaabf7455f73c1376f/users/5b00baeee8c349de9b4d3d5d7625aef4/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:20.804651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08b596-7c8b-4a51-ac54-b7fbebb5327d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0b207ef29e4cbaabf7455f73c1376f, user_id=5b00baeee8c349de9b4d3d5d7625aef4, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:20.808551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08b596-7c8b-4a51-ac54-b7fbebb5327d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:20.831214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 889/1768] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:20 2022] PUT /identity/v3/projects/be0b207ef29e4cbaabf7455f73c1376f/users/5b00baeee8c349de9b4d3d5d7625aef4/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:20.832953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4435-4ffd-47f4-9cb5-5470b4494c9a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:20.845642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4435-4ffd-47f4-9cb5-5470b4494c9a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:20.883665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08b596-7c8b-4a51-ac54-b7fbebb5327d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:20.886483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0e08b596-7c8b-4a51-ac54-b7fbebb5327d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:20.939774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4fc3d-8b4c-4380-aa7d-d50ef0178332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:20.940599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4fc3d-8b4c-4380-aa7d-d50ef0178332 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:20.940890 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4fc3d-8b4c-4380-aa7d-d50ef0178332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:20.941204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4fc3d-8b4c-4380-aa7d-d50ef0178332 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:20.942064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4fc3d-8b4c-4380-aa7d-d50ef0178332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:20.944040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4fc3d-8b4c-4380-aa7d-d50ef0178332 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:20.958575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 880/1769] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:25:20.963999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4fc3d-8b4c-4380-aa7d-d50ef0178332 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:20.982933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4fc3d-8b4c-4380-aa7d-d50ef0178332 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:20.989490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfdb2f-5829-4a76-bc0f-ac5452718e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:20.990765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfdb2f-5829-4a76-bc0f-ac5452718e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:20.991369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfdb2f-5829-4a76-bc0f-ac5452718e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:20.991708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfdb2f-5829-4a76-bc0f-ac5452718e29 admin admin] PATH_INFO: `/v3/projects/be0b207ef29e4cbaabf7455f73c1376f/users/5b00baeee8c349de9b4d3d5d7625aef4/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:20.994500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfdb2f-5829-4a76-bc0f-ac5452718e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0b207ef29e4cbaabf7455f73c1376f, user_id=5b00baeee8c349de9b4d3d5d7625aef4, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:20.994758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08b596-7c8b-4a51-ac54-b7fbebb5327d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:20.997699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfdb2f-5829-4a76-bc0f-ac5452718e29 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:21.000914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:21.001803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.002166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.002426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] PATH_INFO: `/v3/projects/88d008c52d4b4935b2286f296fc3c569` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.004080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d008c52d4b4935b2286f296fc3c569)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:21.006586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:21.025302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 881/1770] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:20 2022] PUT /identity/v3/projects/be0b207ef29e4cbaabf7455f73c1376f/users/5b00baeee8c349de9b4d3d5d7625aef4/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:21.030477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6797b3-9005-4000-80c2-c54e72ab5087 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.030770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6797b3-9005-4000-80c2-c54e72ab5087 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.031050 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6797b3-9005-4000-80c2-c54e72ab5087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.069564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-af6797b3-9005-4000-80c2-c54e72ab5087 None None] MFA Rules not processed for user `5b00baeee8c349de9b4d3d5d7625aef4`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:21.070809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-af6797b3-9005-4000-80c2-c54e72ab5087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:21.087028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d008c52d4b4935b2286f296fc3c569', 'request_id': 'req-463e5895-5baa-4c56-a8a6-902cbf3d0a76'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:21.096386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d008c52d4b4935b2286f296fc3c569', 'request_id': 'req-463e5895-5baa-4c56-a8a6-902cbf3d0a76'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:21.105361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d008c52d4b4935b2286f296fc3c569', 'request_id': 'req-463e5895-5baa-4c56-a8a6-902cbf3d0a76'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:21.123287 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] The token cache is being invalidate because project 88d008c52d4b4935b2286f296fc3c569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:21.123606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:21.124505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-463e5895-5baa-4c56-a8a6-902cbf3d0a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:21.131820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 890/1771] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:20 2022] DELETE /identity/v3/projects/88d008c52d4b4935b2286f296fc3c569 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:21.135744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bba5b-f543-4b9b-9fa6-4a08adb58037 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.136001 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bba5b-f543-4b9b-9fa6-4a08adb58037 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.136316 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bba5b-f543-4b9b-9fa6-4a08adb58037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.160968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-a92bba5b-f543-4b9b-9fa6-4a08adb58037 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:21.162234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a92bba5b-f543-4b9b-9fa6-4a08adb58037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:21.196887 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 882/1772] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:21.204865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6797b3-9005-4000-80c2-c54e72ab5087 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:21.206500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-af6797b3-9005-4000-80c2-c54e72ab5087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:21.269680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 891/1773] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:21.277162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6797b3-9005-4000-80c2-c54e72ab5087 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:21.277412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8d09-7d2d-4c58-beea-dcca5990653c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.277684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8d09-7d2d-4c58-beea-dcca5990653c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.277937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8d09-7d2d-4c58-beea-dcca5990653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.282134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda8627-a4c5-4a3e-b3a1-7bea3f47ff2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:21.282853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda8627-a4c5-4a3e-b3a1-7bea3f47ff2e service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.283301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda8627-a4c5-4a3e-b3a1-7bea3f47ff2e service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.284473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda8627-a4c5-4a3e-b3a1-7bea3f47ff2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.295084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda8627-a4c5-4a3e-b3a1-7bea3f47ff2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:21.296563 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda8627-a4c5-4a3e-b3a1-7bea3f47ff2e service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:21.301627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-20cd8d09-7d2d-4c58-beea-dcca5990653c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:21.303126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-20cd8d09-7d2d-4c58-beea-dcca5990653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:21.309252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 883/1774] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:21 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:21.318522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda8627-a4c5-4a3e-b3a1-7bea3f47ff2e service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:21.320841 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 892/1775] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:21.338070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda8627-a4c5-4a3e-b3a1-7bea3f47ff2e service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:21.343543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c6ead-12a9-470a-90cf-6b8ba7a59490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:21.344230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c6ead-12a9-470a-90cf-6b8ba7a59490 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.344509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c6ead-12a9-470a-90cf-6b8ba7a59490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.344782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c6ead-12a9-470a-90cf-6b8ba7a59490 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.345591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c6ead-12a9-470a-90cf-6b8ba7a59490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:25:21.347007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c6ead-12a9-470a-90cf-6b8ba7a59490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:21.347659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c6ead-12a9-470a-90cf-6b8ba7a59490 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:21.361202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 884/1776] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:25:21.366131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8d09-7d2d-4c58-beea-dcca5990653c None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:21.379480 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8d09-7d2d-4c58-beea-dcca5990653c None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:21.384547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703445-169a-4550-a421-77687199c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:21.385276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703445-169a-4550-a421-77687199c8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.385575 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703445-169a-4550-a421-77687199c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.385847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703445-169a-4550-a421-77687199c8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.386699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33703445-169a-4550-a421-77687199c8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:21.388585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33703445-169a-4550-a421-77687199c8e6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:21.426477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 893/1777] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:21 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:25:21.431849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c6ead-12a9-470a-90cf-6b8ba7a59490 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:21.444874 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c6ead-12a9-470a-90cf-6b8ba7a59490 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:21.521802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8fecc-5c4e-4b3b-9179-bdf86be6c5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:21.522596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8fecc-5c4e-4b3b-9179-bdf86be6c5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.523090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8fecc-5c4e-4b3b-9179-bdf86be6c5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.523346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8fecc-5c4e-4b3b-9179-bdf86be6c5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.524139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8fecc-5c4e-4b3b-9179-bdf86be6c5d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:21.526354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8fecc-5c4e-4b3b-9179-bdf86be6c5d7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:21.548999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703445-169a-4550-a421-77687199c8e6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:21.550808 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-33703445-169a-4550-a421-77687199c8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:21.573653 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 885/1778] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:21 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:21.575224 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8fecc-5c4e-4b3b-9179-bdf86be6c5d7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:21.587515 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8fecc-5c4e-4b3b-9179-bdf86be6c5d7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:21.595874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703445-169a-4550-a421-77687199c8e6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:21.596107 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b72546-1de9-4c48-8d54-420824dde63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:21.596824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b72546-1de9-4c48-8d54-420824dde63f admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.596824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b72546-1de9-4c48-8d54-420824dde63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.596824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b72546-1de9-4c48-8d54-420824dde63f admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.597718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b72546-1de9-4c48-8d54-420824dde63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:21.600263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b72546-1de9-4c48-8d54-420824dde63f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:21.606014 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:21.606903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.607295 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.607505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] PATH_INFO: `/v3/users/10b842d2ca5f47c4b6098a3a0bda4d89` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.609403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b842d2ca5f47c4b6098a3a0bda4d89)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:21.611382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:21.618441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 886/1779] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:21.624640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b72546-1de9-4c48-8d54-420824dde63f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:21.641491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b72546-1de9-4c48-8d54-420824dde63f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:21.646995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a432133-5d47-472f-8720-318051dea188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:21.647775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a432133-5d47-472f-8720-318051dea188 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.648121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a432133-5d47-472f-8720-318051dea188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.648459 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a432133-5d47-472f-8720-318051dea188 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.649318 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a432133-5d47-472f-8720-318051dea188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:21.651131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a432133-5d47-472f-8720-318051dea188 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:21.665276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 887/1780] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:21.669973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a432133-5d47-472f-8720-318051dea188 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:21.681406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a432133-5d47-472f-8720-318051dea188 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:21.686611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f789f4-32ac-4279-849d-f4ec7c24aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:21.687703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f789f4-32ac-4279-849d-f4ec7c24aa1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.688060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f789f4-32ac-4279-849d-f4ec7c24aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.688397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f789f4-32ac-4279-849d-f4ec7c24aa1e admin admin] PATH_INFO: `/v3/projects/1a76c50170904c9998132d76e08cc94d/users/6c613d12df3040e789f051385ca1f5b7/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.700621 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b842d2ca5f47c4b6098a3a0bda4d89'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:21.709826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b842d2ca5f47c4b6098a3a0bda4d89'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:21.710667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b842d2ca5f47c4b6098a3a0bda4d89'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:21.720059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b842d2ca5f47c4b6098a3a0bda4d89'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:21.721059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f789f4-32ac-4279-849d-f4ec7c24aa1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a76c50170904c9998132d76e08cc94d, user_id=6c613d12df3040e789f051385ca1f5b7, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:21.725494 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f789f4-32ac-4279-849d-f4ec7c24aa1e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:21.737693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a15f6b5e-eb5f-4497-87b0-ecde76efa2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b842d2ca5f47c4b6098a3a0bda4d89'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:21.748022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 894/1781] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:21 2022] DELETE /identity/v3/users/10b842d2ca5f47c4b6098a3a0bda4d89 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:21.753999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770ebe-c17b-423f-bbbc-eedf39b380dc None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.756864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770ebe-c17b-423f-bbbc-eedf39b380dc None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.758244 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a770ebe-c17b-423f-bbbc-eedf39b380dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.761909 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 888/1782] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:21 2022] PUT /identity/v3/projects/1a76c50170904c9998132d76e08cc94d/users/6c613d12df3040e789f051385ca1f5b7/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:21.788973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6665f1-d5ed-4e80-a822-f242ac392660 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.789388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6665f1-d5ed-4e80-a822-f242ac392660 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.789734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6665f1-d5ed-4e80-a822-f242ac392660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.820284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-6a770ebe-c17b-423f-bbbc-eedf39b380dc None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:21.821961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-fc6665f1-d5ed-4e80-a822-f242ac392660 None None] MFA Rules not processed for user `6c613d12df3040e789f051385ca1f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:21.823242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fc6665f1-d5ed-4e80-a822-f242ac392660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:21.823933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6a770ebe-c17b-423f-bbbc-eedf39b380dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:21.922790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 895/1783] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:21.924175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 889/1784] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:21.930928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a770ebe-c17b-423f-bbbc-eedf39b380dc None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:21.936848 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6a770ebe-c17b-423f-bbbc-eedf39b380dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:21.940242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6665f1-d5ed-4e80-a822-f242ac392660 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:21.946496 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fc6665f1-d5ed-4e80-a822-f242ac392660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:21.968358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a770ebe-c17b-423f-bbbc-eedf39b380dc None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:21.978273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493856fb-5c02-4d70-8307-2984953e3ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:21.979590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493856fb-5c02-4d70-8307-2984953e3ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:21.980119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493856fb-5c02-4d70-8307-2984953e3ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:21.980623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493856fb-5c02-4d70-8307-2984953e3ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:21.982141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493856fb-5c02-4d70-8307-2984953e3ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:21.985940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493856fb-5c02-4d70-8307-2984953e3ea7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:22.037697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 896/1785] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:21 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:22.039493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493856fb-5c02-4d70-8307-2984953e3ea7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:22.047636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6665f1-d5ed-4e80-a822-f242ac392660 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:22.115835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992beb4-6565-4aae-b254-341987350d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:22.116744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992beb4-6565-4aae-b254-341987350d90 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.116744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992beb4-6565-4aae-b254-341987350d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.117035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992beb4-6565-4aae-b254-341987350d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.154036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493856fb-5c02-4d70-8307-2984953e3ea7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:22.163642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce59ba8-ba38-40a4-a2a6-1c231b43e7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:22.165057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce59ba8-ba38-40a4-a2a6-1c231b43e7db admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.165703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce59ba8-ba38-40a4-a2a6-1c231b43e7db admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.166210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce59ba8-ba38-40a4-a2a6-1c231b43e7db admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.167774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce59ba8-ba38-40a4-a2a6-1c231b43e7db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:22.169977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce59ba8-ba38-40a4-a2a6-1c231b43e7db admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:22.196233 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 897/1786] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:22 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:22.197752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce59ba8-ba38-40a4-a2a6-1c231b43e7db admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:22.205995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992beb4-6565-4aae-b254-341987350d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:22.207463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992beb4-6565-4aae-b254-341987350d90 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:22.212027 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce59ba8-ba38-40a4-a2a6-1c231b43e7db admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:22.218784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bfd50-3306-4719-9105-536240c5b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:22.219159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 890/1787] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:22.219553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfd50-3306-4719-9105-536240c5b20b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.219841 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfd50-3306-4719-9105-536240c5b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.220178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfd50-3306-4719-9105-536240c5b20b admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.220972 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bfd50-3306-4719-9105-536240c5b20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:22.222701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bfd50-3306-4719-9105-536240c5b20b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:22.238840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2faed-b6dd-4b3a-8770-eecac82be488 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.239170 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2faed-b6dd-4b3a-8770-eecac82be488 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.239263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 898/1788] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:22.239407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2faed-b6dd-4b3a-8770-eecac82be488 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.240566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bfd50-3306-4719-9105-536240c5b20b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:22.241678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 891/1789] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jan 28 01:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:25:22.256929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bfd50-3306-4719-9105-536240c5b20b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:22.265708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcf34a-0a15-4dc0-9aee-4171cc143ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:22.267280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcf34a-0a15-4dc0-9aee-4171cc143ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.267600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcf34a-0a15-4dc0-9aee-4171cc143ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.268438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcf34a-0a15-4dc0-9aee-4171cc143ccc admin admin] PATH_INFO: `/v3/projects/1db385c40538494bb9a940d2382575ed/users/151aefbb2d384a62bc291e4e77cdc283/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.298752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcf34a-0a15-4dc0-9aee-4171cc143ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db385c40538494bb9a940d2382575ed, user_id=151aefbb2d384a62bc291e4e77cdc283, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:22.302090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcf34a-0a15-4dc0-9aee-4171cc143ccc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:22.324262 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 899/1790] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:22 2022] PUT /identity/v3/projects/1db385c40538494bb9a940d2382575ed/users/151aefbb2d384a62bc291e4e77cdc283/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:22.328379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b9ba-97fe-4e07-9c0b-ea50a105a47a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.328379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b9ba-97fe-4e07-9c0b-ea50a105a47a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.328379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2b9ba-97fe-4e07-9c0b-ea50a105a47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.333474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcf34a-0a15-4dc0-9aee-4171cc143ccc admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:22.378830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-15e2b9ba-97fe-4e07-9c0b-ea50a105a47a None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:22.380086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-15e2b9ba-97fe-4e07-9c0b-ea50a105a47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:22.518406 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcf34a-0a15-4dc0-9aee-4171cc143ccc admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:22.530352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f31eb-52b8-4fa5-a7b7-50d91d05557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:22.533094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f31eb-52b8-4fa5-a7b7-50d91d05557f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.533719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f31eb-52b8-4fa5-a7b7-50d91d05557f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.534769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f31eb-52b8-4fa5-a7b7-50d91d05557f admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.536247 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f31eb-52b8-4fa5-a7b7-50d91d05557f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:22.539879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f31eb-52b8-4fa5-a7b7-50d91d05557f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:22.557481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 892/1791] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jan 28 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:22.559359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a07f79-2158-42bb-8c5b-eea7b3d00bbd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.566860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a07f79-2158-42bb-8c5b-eea7b3d00bbd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.566860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a07f79-2158-42bb-8c5b-eea7b3d00bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.567317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 900/1792] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:22.568517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f31eb-52b8-4fa5-a7b7-50d91d05557f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:22.597054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f31eb-52b8-4fa5-a7b7-50d91d05557f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:22.613059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff64b7-ea09-44e7-b3f0-15620c4151a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:22.613059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff64b7-ea09-44e7-b3f0-15620c4151a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.613059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff64b7-ea09-44e7-b3f0-15620c4151a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.613059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff64b7-ea09-44e7-b3f0-15620c4151a8 admin admin] PATH_INFO: `/v3/projects/1db385c40538494bb9a940d2382575ed/users/151aefbb2d384a62bc291e4e77cdc283/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.617344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff64b7-ea09-44e7-b3f0-15620c4151a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db385c40538494bb9a940d2382575ed, user_id=151aefbb2d384a62bc291e4e77cdc283, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:22.626929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff64b7-ea09-44e7-b3f0-15620c4151a8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:22.633000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-90a07f79-2158-42bb-8c5b-eea7b3d00bbd None None] MFA Rules not processed for user `7fd3428820c341ff9665152c17192b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:22.636056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-90a07f79-2158-42bb-8c5b-eea7b3d00bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:22.657970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 901/1793] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:22 2022] PUT /identity/v3/projects/1db385c40538494bb9a940d2382575ed/users/151aefbb2d384a62bc291e4e77cdc283/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:22.657970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff64b7-ea09-44e7-b3f0-15620c4151a8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:22.672783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d3ff64b7-ea09-44e7-b3f0-15620c4151a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:22.754415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 893/1794] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:22.755840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32941ce0-09b9-415a-a3aa-643c7cb03a28 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.756127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32941ce0-09b9-415a-a3aa-643c7cb03a28 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.756406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32941ce0-09b9-415a-a3aa-643c7cb03a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.823909 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-32941ce0-09b9-415a-a3aa-643c7cb03a28 None None] MFA Rules not processed for user `151aefbb2d384a62bc291e4e77cdc283`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:22.826632 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-32941ce0-09b9-415a-a3aa-643c7cb03a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:22.828919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff64b7-ea09-44e7-b3f0-15620c4151a8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:22.837943 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435e27-dca9-4a7f-a4d0-10ff8936ea48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:22.838100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435e27-dca9-4a7f-a4d0-10ff8936ea48 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.838393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435e27-dca9-4a7f-a4d0-10ff8936ea48 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.838667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435e27-dca9-4a7f-a4d0-10ff8936ea48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.858233 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435e27-dca9-4a7f-a4d0-10ff8936ea48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:22.860438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435e27-dca9-4a7f-a4d0-10ff8936ea48 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:22.875784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 902/1795] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:22.876541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435e27-dca9-4a7f-a4d0-10ff8936ea48 service nova] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:22.878768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-37435e27-dca9-4a7f-a4d0-10ff8936ea48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:22.963468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 894/1796] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:22.963468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32941ce0-09b9-415a-a3aa-643c7cb03a28 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:22.963950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-32941ce0-09b9-415a-a3aa-643c7cb03a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:22.964875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435e27-dca9-4a7f-a4d0-10ff8936ea48 service nova] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:22.972055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a9c0-0d03-4c41-94cd-99549cae7ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:22.982607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a9c0-0d03-4c41-94cd-99549cae7ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:22.983147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a9c0-0d03-4c41-94cd-99549cae7ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:22.983581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61a9c0-0d03-4c41-94cd-99549cae7ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:22.988114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9a61a9c0-0d03-4c41-94cd-99549cae7ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:23.069846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32941ce0-09b9-415a-a3aa-643c7cb03a28 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:23.072167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61a9c0-0d03-4c41-94cd-99549cae7ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:23.074606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61a9c0-0d03-4c41-94cd-99549cae7ea0 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:23.081154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:23.082090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:23.082370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:23.082642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] PATH_INFO: `/v3/projects/4f95da5ee65c4b3cbac71978d2c492e6` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:23.083907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f95da5ee65c4b3cbac71978d2c492e6)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:23.086323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:23.089959 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 903/1797] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:23.091345 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a9c0-0d03-4c41-94cd-99549cae7ea0 service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:23.093385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9a61a9c0-0d03-4c41-94cd-99549cae7ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:23.110279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61a9c0-0d03-4c41-94cd-99549cae7ea0 service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:23.116026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd665a76-ec16-42b6-8828-3f6e2138a0da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:23.116992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665a76-ec16-42b6-8828-3f6e2138a0da service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:23.117498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665a76-ec16-42b6-8828-3f6e2138a0da service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:23.117917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd665a76-ec16-42b6-8828-3f6e2138a0da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:23.143014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f95da5ee65c4b3cbac71978d2c492e6', 'request_id': 'req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:23.154111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f95da5ee65c4b3cbac71978d2c492e6', 'request_id': 'req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:23.162363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f95da5ee65c4b3cbac71978d2c492e6', 'request_id': 'req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:23.174747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] The token cache is being invalidate because project 4f95da5ee65c4b3cbac71978d2c492e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:23.175014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:23.175720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:23.177756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 895/1798] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:22 2022] DELETE /identity/v3/projects/4f95da5ee65c4b3cbac71978d2c492e6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:23.181781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:23.183210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:23.202110 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd665a76-ec16-42b6-8828-3f6e2138a0da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:23.203629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd665a76-ec16-42b6-8828-3f6e2138a0da service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:23.215191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 904/1799] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:23.272735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1385e16-f719-4e73-9e2e-4b8bb77fe1b9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:23.277980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:23.279044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:23.279334 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:23.279657 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] PATH_INFO: `/v3/users/5b00baeee8c349de9b4d3d5d7625aef4` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:23.282219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b00baeee8c349de9b4d3d5d7625aef4)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:23.284796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:23.349259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b00baeee8c349de9b4d3d5d7625aef4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:23.359568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b00baeee8c349de9b4d3d5d7625aef4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:23.380470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b00baeee8c349de9b4d3d5d7625aef4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:23.382116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b00baeee8c349de9b4d3d5d7625aef4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:23.404685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b00baeee8c349de9b4d3d5d7625aef4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:23.419502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 896/1800] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:23 2022] DELETE /identity/v3/users/5b00baeee8c349de9b4d3d5d7625aef4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:24.273292 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd665a76-ec16-42b6-8828-3f6e2138a0da service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:24.293710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd665a76-ec16-42b6-8828-3f6e2138a0da service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:24.466432 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:24.467586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:24.467873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:24.468148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] PATH_INFO: `/v3/projects/be0b207ef29e4cbaabf7455f73c1376f` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:24.470218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0b207ef29e4cbaabf7455f73c1376f)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:24.472798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:24.553634 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:24.555555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:24.568779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0b207ef29e4cbaabf7455f73c1376f', 'request_id': 'req-69e20b18-51ab-4f11-9803-386679dfd818'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:24.577617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0b207ef29e4cbaabf7455f73c1376f', 'request_id': 'req-69e20b18-51ab-4f11-9803-386679dfd818'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:24.603260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0b207ef29e4cbaabf7455f73c1376f', 'request_id': 'req-69e20b18-51ab-4f11-9803-386679dfd818'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:24.646523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] The token cache is being invalidate because project be0b207ef29e4cbaabf7455f73c1376f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:24.646985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:24.651849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-69e20b18-51ab-4f11-9803-386679dfd818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:24.666113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 905/1801] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:24 2022] DELETE /identity/v3/projects/be0b207ef29e4cbaabf7455f73c1376f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:24.675279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8599c-5cee-486f-939a-ad42a3ed24f5 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:24.681156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8599c-5cee-486f-939a-ad42a3ed24f5 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:24.681760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8599c-5cee-486f-939a-ad42a3ed24f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:24.711504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b25c9-99b8-43a1-b6d8-d53c0ca3ac5a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:24.725788 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-77a8599c-5cee-486f-939a-ad42a3ed24f5 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:24.728791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-77a8599c-5cee-486f-939a-ad42a3ed24f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:24.881022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 906/1802] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:24.883423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc684b-c0c1-4be2-9beb-679438c50029 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:24.883882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc684b-c0c1-4be2-9beb-679438c50029 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:24.884326 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc684b-c0c1-4be2-9beb-679438c50029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:24.946833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-96cc684b-c0c1-4be2-9beb-679438c50029 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:24.948955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-96cc684b-c0c1-4be2-9beb-679438c50029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:25.002269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843c6dc-30ef-4989-b1c5-dd714bca1a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:25.006721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 907/1803] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:25.008398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc684b-c0c1-4be2-9beb-679438c50029 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:25.009612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843c6dc-30ef-4989-b1c5-dd714bca1a69 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:25.010082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843c6dc-30ef-4989-b1c5-dd714bca1a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:25.010648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843c6dc-30ef-4989-b1c5-dd714bca1a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:25.018408 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b843c6dc-30ef-4989-b1c5-dd714bca1a69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:25.060687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc684b-c0c1-4be2-9beb-679438c50029 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:25.096180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d263dd0-185a-49a8-884b-705782ef7aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:25.098977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d263dd0-185a-49a8-884b-705782ef7aed admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:25.101118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d263dd0-185a-49a8-884b-705782ef7aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:25.101798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d263dd0-185a-49a8-884b-705782ef7aed admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:25.105868 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d263dd0-185a-49a8-884b-705782ef7aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:25:25.110015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d263dd0-185a-49a8-884b-705782ef7aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:25.115211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d263dd0-185a-49a8-884b-705782ef7aed admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:25.174582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 908/1804] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:25:25.179067 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d263dd0-185a-49a8-884b-705782ef7aed admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:25.231242 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d263dd0-185a-49a8-884b-705782ef7aed admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:25.248603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a214fb-e7d9-4cea-a083-afd564822eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:25.252704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a214fb-e7d9-4cea-a083-afd564822eda admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:25.253540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a214fb-e7d9-4cea-a083-afd564822eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:25.255873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a214fb-e7d9-4cea-a083-afd564822eda admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:25.260464 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a214fb-e7d9-4cea-a083-afd564822eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:25.265424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a214fb-e7d9-4cea-a083-afd564822eda admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:25.382345 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 909/1805] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:25 2022] POST /identity/v3/projects => generated 361 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:25.390685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a214fb-e7d9-4cea-a083-afd564822eda admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:25.398965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843c6dc-30ef-4989-b1c5-dd714bca1a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:25.410160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843c6dc-30ef-4989-b1c5-dd714bca1a69 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:25.459375 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 897/1806] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 907 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:25.666348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a214fb-e7d9-4cea-a083-afd564822eda admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:25.686262 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e8ce9-2c47-48e0-aa59-313d76bdb8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:25.687869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e8ce9-2c47-48e0-aa59-313d76bdb8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:25.688479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e8ce9-2c47-48e0-aa59-313d76bdb8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:25.689157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e8ce9-2c47-48e0-aa59-313d76bdb8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:25.691221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e8ce9-2c47-48e0-aa59-313d76bdb8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:25.703058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e8ce9-2c47-48e0-aa59-313d76bdb8f7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:25.785107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 910/1807] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:25 2022] POST /identity/v3/users => generated 281 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:25.787740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843c6dc-30ef-4989-b1c5-dd714bca1a69 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:25.807315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843c6dc-30ef-4989-b1c5-dd714bca1a69 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:25.868207 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4d1c9-18a5-423a-bc9a-c87f8b91edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:25.868950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4d1c9-18a5-423a-bc9a-c87f8b91edb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:25.869271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4d1c9-18a5-423a-bc9a-c87f8b91edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:25.869561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4d1c9-18a5-423a-bc9a-c87f8b91edb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:25.870345 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4d1c9-18a5-423a-bc9a-c87f8b91edb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:25.880932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4d1c9-18a5-423a-bc9a-c87f8b91edb1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:25.919556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e8ce9-2c47-48e0-aa59-313d76bdb8f7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:25.919791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 898/1808] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:25.951612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e8ce9-2c47-48e0-aa59-313d76bdb8f7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:25.958741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6d79-6cb8-41a1-8620-ec2aeaee0a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:25.960282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6d79-6cb8-41a1-8620-ec2aeaee0a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:25.962595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6d79-6cb8-41a1-8620-ec2aeaee0a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:25.964100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6d79-6cb8-41a1-8620-ec2aeaee0a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:25.965387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6d79-6cb8-41a1-8620-ec2aeaee0a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:25.967358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6d79-6cb8-41a1-8620-ec2aeaee0a15 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:25.988394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 911/1809] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:25:25.993191 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4d1c9-18a5-423a-bc9a-c87f8b91edb1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:26.005482 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4d1c9-18a5-423a-bc9a-c87f8b91edb1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:26.024424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc8591-a9e0-4140-9717-7d8973c7259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:26.025379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc8591-a9e0-4140-9717-7d8973c7259a admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:26.025664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc8591-a9e0-4140-9717-7d8973c7259a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:26.026029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc8591-a9e0-4140-9717-7d8973c7259a admin admin] PATH_INFO: `/v3/projects/fbd40a89ded14b56b80757c29ffbc2b3/users/1da59e6ed6f64e3ca342f21f4a91f88a/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:26.057906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc8591-a9e0-4140-9717-7d8973c7259a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd40a89ded14b56b80757c29ffbc2b3, user_id=1da59e6ed6f64e3ca342f21f4a91f88a, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:26.060704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc8591-a9e0-4140-9717-7d8973c7259a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:26.123092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 899/1810] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:25 2022] PUT /identity/v3/projects/fbd40a89ded14b56b80757c29ffbc2b3/users/1da59e6ed6f64e3ca342f21f4a91f88a/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:26.125742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb24b7-f1a7-439b-9729-0be39eb5578a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:26.126552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb24b7-f1a7-439b-9729-0be39eb5578a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:26.127100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb24b7-f1a7-439b-9729-0be39eb5578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:26.253646 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-78bb24b7-f1a7-439b-9729-0be39eb5578a None None] MFA Rules not processed for user `1da59e6ed6f64e3ca342f21f4a91f88a`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:26.255211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-78bb24b7-f1a7-439b-9729-0be39eb5578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:26.461719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc8591-a9e0-4140-9717-7d8973c7259a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:26.468741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 912/1811] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:26.573764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc8591-a9e0-4140-9717-7d8973c7259a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:26.579535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee890db9-305a-4772-a38e-1112b9454489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:26.580272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee890db9-305a-4772-a38e-1112b9454489 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:26.580610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee890db9-305a-4772-a38e-1112b9454489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:26.580941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee890db9-305a-4772-a38e-1112b9454489 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:26.582374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee890db9-305a-4772-a38e-1112b9454489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:26.584831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee890db9-305a-4772-a38e-1112b9454489 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:26.644012 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 900/1812] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:26 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:26.647925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb24b7-f1a7-439b-9729-0be39eb5578a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:26.660960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb24b7-f1a7-439b-9729-0be39eb5578a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:26.745854 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00c3aa-c4d4-493f-a571-e277ae6c849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:26.746958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00c3aa-c4d4-493f-a571-e277ae6c849c admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:26.747413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00c3aa-c4d4-493f-a571-e277ae6c849c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:26.747891 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00c3aa-c4d4-493f-a571-e277ae6c849c admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:26.748680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00c3aa-c4d4-493f-a571-e277ae6c849c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:26.750739 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00c3aa-c4d4-493f-a571-e277ae6c849c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:26.782352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 913/1813] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:26 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:25:26.786654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee890db9-305a-4772-a38e-1112b9454489 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:26.801078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee890db9-305a-4772-a38e-1112b9454489 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:26.811500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aae28d-eb0e-4f81-8934-2a6b0ef26531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:26.813155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae28d-eb0e-4f81-8934-2a6b0ef26531 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:26.813692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae28d-eb0e-4f81-8934-2a6b0ef26531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:26.814031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aae28d-eb0e-4f81-8934-2a6b0ef26531 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:26.815715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aae28d-eb0e-4f81-8934-2a6b0ef26531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:26.817640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aae28d-eb0e-4f81-8934-2a6b0ef26531 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:26.833737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 901/1814] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:26.838316 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00c3aa-c4d4-493f-a571-e277ae6c849c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:26.849390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00c3aa-c4d4-493f-a571-e277ae6c849c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:26.855284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81b0cf-d1fb-4e39-b76b-4e1bc35a846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:26.856054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81b0cf-d1fb-4e39-b76b-4e1bc35a846a admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:26.856314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81b0cf-d1fb-4e39-b76b-4e1bc35a846a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:26.856583 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81b0cf-d1fb-4e39-b76b-4e1bc35a846a admin admin] PATH_INFO: `/v3/projects/f78e7d8f41e342eaae69c0fe57660716/users/a566170d02204b25bf4635f9df2241d5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:26.874063 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81b0cf-d1fb-4e39-b76b-4e1bc35a846a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78e7d8f41e342eaae69c0fe57660716, user_id=a566170d02204b25bf4635f9df2241d5, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:26.877105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81b0cf-d1fb-4e39-b76b-4e1bc35a846a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:26.895038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 914/1815] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:26 2022] PUT /identity/v3/projects/f78e7d8f41e342eaae69c0fe57660716/users/a566170d02204b25bf4635f9df2241d5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:26.899288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aae28d-eb0e-4f81-8934-2a6b0ef26531 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:26.909836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aae28d-eb0e-4f81-8934-2a6b0ef26531 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:26.981930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd9a6f-317b-4e1c-b695-a8bc32fc18a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:26.982711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd9a6f-317b-4e1c-b695-a8bc32fc18a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:26.983029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd9a6f-317b-4e1c-b695-a8bc32fc18a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:26.983361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd9a6f-317b-4e1c-b695-a8bc32fc18a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:26.984275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd9a6f-317b-4e1c-b695-a8bc32fc18a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:26.986547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd9a6f-317b-4e1c-b695-a8bc32fc18a3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:26.998317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 902/1816] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:27.003045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81b0cf-d1fb-4e39-b76b-4e1bc35a846a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:27.014529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81b0cf-d1fb-4e39-b76b-4e1bc35a846a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:27.019100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a463a-f0c1-4a35-9d8a-d94b2cfc6233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:27.020013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a463a-f0c1-4a35-9d8a-d94b2cfc6233 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:27.020281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a463a-f0c1-4a35-9d8a-d94b2cfc6233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:27.020558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a463a-f0c1-4a35-9d8a-d94b2cfc6233 admin admin] PATH_INFO: `/v3/projects/f78e7d8f41e342eaae69c0fe57660716/users/a566170d02204b25bf4635f9df2241d5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:27.022560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a463a-f0c1-4a35-9d8a-d94b2cfc6233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78e7d8f41e342eaae69c0fe57660716, user_id=a566170d02204b25bf4635f9df2241d5, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:27.025180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a463a-f0c1-4a35-9d8a-d94b2cfc6233 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:27.036096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 915/1817] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:27 2022] PUT /identity/v3/projects/f78e7d8f41e342eaae69c0fe57660716/users/a566170d02204b25bf4635f9df2241d5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:27.046367 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e4bc-ccab-4da1-aa51-e8fdaf7888c8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:27.046630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e4bc-ccab-4da1-aa51-e8fdaf7888c8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:27.046919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e4bc-ccab-4da1-aa51-e8fdaf7888c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:27.077800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c739e4bc-ccab-4da1-aa51-e8fdaf7888c8 None None] MFA Rules not processed for user `a566170d02204b25bf4635f9df2241d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:27.079009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c739e4bc-ccab-4da1-aa51-e8fdaf7888c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:27.156622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 903/1818] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:27.167643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a463a-f0c1-4a35-9d8a-d94b2cfc6233 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:27.169924 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-656a463a-f0c1-4a35-9d8a-d94b2cfc6233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:27.247550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a463a-f0c1-4a35-9d8a-d94b2cfc6233 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:27.253006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494029c3-9584-4bd8-9653-f8ca44c46995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:27.254055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494029c3-9584-4bd8-9653-f8ca44c46995 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:27.254224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494029c3-9584-4bd8-9653-f8ca44c46995 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:27.254574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494029c3-9584-4bd8-9653-f8ca44c46995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:27.270484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494029c3-9584-4bd8-9653-f8ca44c46995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:27.270484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494029c3-9584-4bd8-9653-f8ca44c46995 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:27.277851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 916/1819] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:27.351599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e4bc-ccab-4da1-aa51-e8fdaf7888c8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:27.361328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e4bc-ccab-4da1-aa51-e8fdaf7888c8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:27.364882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830deaf2-0e65-486d-a9ce-20ce9afd566f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:27.365549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830deaf2-0e65-486d-a9ce-20ce9afd566f service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:27.365825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830deaf2-0e65-486d-a9ce-20ce9afd566f service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:27.366094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830deaf2-0e65-486d-a9ce-20ce9afd566f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:27.428721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830deaf2-0e65-486d-a9ce-20ce9afd566f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:27.430124 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830deaf2-0e65-486d-a9ce-20ce9afd566f service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:27.440137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 904/1820] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:30.001917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494029c3-9584-4bd8-9653-f8ca44c46995 service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:30.035524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494029c3-9584-4bd8-9653-f8ca44c46995 service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:30.043884 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ca4a6-7167-491d-9a2e-f3abd9c9f844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:30.045192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ca4a6-7167-491d-9a2e-f3abd9c9f844 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:30.045932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ca4a6-7167-491d-9a2e-f3abd9c9f844 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:30.046544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ca4a6-7167-491d-9a2e-f3abd9c9f844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:30.054517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f55ca4a6-7167-491d-9a2e-f3abd9c9f844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:30.219992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ca4a6-7167-491d-9a2e-f3abd9c9f844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:30.222210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ca4a6-7167-491d-9a2e-f3abd9c9f844 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:30.259233 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 917/1821] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:31.642505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830deaf2-0e65-486d-a9ce-20ce9afd566f service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:31.718198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830deaf2-0e65-486d-a9ce-20ce9afd566f service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:31.724002 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:31.725026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:31.725442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:31.725816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] PATH_INFO: `/v3/users/1da59e6ed6f64e3ca342f21f4a91f88a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:31.727495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da59e6ed6f64e3ca342f21f4a91f88a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:31.729629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:31.802246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da59e6ed6f64e3ca342f21f4a91f88a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:31.815163 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da59e6ed6f64e3ca342f21f4a91f88a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:31.839588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da59e6ed6f64e3ca342f21f4a91f88a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:31.843390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da59e6ed6f64e3ca342f21f4a91f88a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:31.853555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807f805-5a04-4b95-bf91-e172161a9048 None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:31.854146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807f805-5a04-4b95-bf91-e172161a9048 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:31.854272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807f805-5a04-4b95-bf91-e172161a9048 None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:31.856894 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 918/1822] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jan 28 01:25:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:25:31.862426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fa90dd41-4a3f-44ee-ae70-1b5d37bf2b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da59e6ed6f64e3ca342f21f4a91f88a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:31.874425 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b978d-4539-4da5-834e-2c7d47500cc9 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:31.874712 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b978d-4539-4da5-834e-2c7d47500cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:31.874990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b978d-4539-4da5-834e-2c7d47500cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:31.885679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 905/1823] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:31 2022] DELETE /identity/v3/users/1da59e6ed6f64e3ca342f21f4a91f88a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:31.889184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82166c-cea2-430b-9428-efd1e1014382 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:31.889622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82166c-cea2-430b-9428-efd1e1014382 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:31.889891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82166c-cea2-430b-9428-efd1e1014382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:31.907660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1b5b978d-4539-4da5-834e-2c7d47500cc9 None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:31.907660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1b5b978d-4539-4da5-834e-2c7d47500cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:31.921480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9b82166c-cea2-430b-9428-efd1e1014382 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:31.922817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9b82166c-cea2-430b-9428-efd1e1014382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:31.992593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 919/1824] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jan 28 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:31.994521 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 906/1825] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:32.004314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b978d-4539-4da5-834e-2c7d47500cc9 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:32.005804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1b5b978d-4539-4da5-834e-2c7d47500cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:32.067251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b978d-4539-4da5-834e-2c7d47500cc9 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:32.071608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faffd8-c596-46ba-940a-2ac0a40f1dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:32.072285 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faffd8-c596-46ba-940a-2ac0a40f1dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:32.072548 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faffd8-c596-46ba-940a-2ac0a40f1dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:32.072826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faffd8-c596-46ba-940a-2ac0a40f1dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:32.085257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09faffd8-c596-46ba-940a-2ac0a40f1dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:32.086993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09faffd8-c596-46ba-940a-2ac0a40f1dd8 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:32.098254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 920/1826] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:32.124363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82166c-cea2-430b-9428-efd1e1014382 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:32.125831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9b82166c-cea2-430b-9428-efd1e1014382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:32.142980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82166c-cea2-430b-9428-efd1e1014382 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:32.158224 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedbebb-02d8-4904-bee2-292d9039581d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:32.158927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedbebb-02d8-4904-bee2-292d9039581d service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:32.159213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedbebb-02d8-4904-bee2-292d9039581d service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:32.159520 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedbebb-02d8-4904-bee2-292d9039581d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:32.171387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedbebb-02d8-4904-bee2-292d9039581d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:32.173040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedbebb-02d8-4904-bee2-292d9039581d service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:32.186284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 907/1827] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:32.414631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faffd8-c596-46ba-940a-2ac0a40f1dd8 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:32.416269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-09faffd8-c596-46ba-940a-2ac0a40f1dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:32.434285 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faffd8-c596-46ba-940a-2ac0a40f1dd8 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:32.440001 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:32.440885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:32.441179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:32.441450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] PATH_INFO: `/v3/projects/fbd40a89ded14b56b80757c29ffbc2b3` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:32.442736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd40a89ded14b56b80757c29ffbc2b3)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:32.444696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:32.500672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd40a89ded14b56b80757c29ffbc2b3', 'request_id': 'req-4dc0fe09-909a-4739-869e-8a12f9c57794'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:32.507586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd40a89ded14b56b80757c29ffbc2b3', 'request_id': 'req-4dc0fe09-909a-4739-869e-8a12f9c57794'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:32.515638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd40a89ded14b56b80757c29ffbc2b3', 'request_id': 'req-4dc0fe09-909a-4739-869e-8a12f9c57794'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:32.532386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] The token cache is being invalidate because project fbd40a89ded14b56b80757c29ffbc2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:32.533011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:32.534271 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:32.537314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 921/1828] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:32 2022] DELETE /identity/v3/projects/fbd40a89ded14b56b80757c29ffbc2b3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:32.541161 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedbebb-02d8-4904-bee2-292d9039581d service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:32.552602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedbebb-02d8-4904-bee2-292d9039581d service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:32.638848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:32.639741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:32.640021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:32.640290 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] PATH_INFO: `/v3/users/a566170d02204b25bf4635f9df2241d5` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:32.641633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a566170d02204b25bf4635f9df2241d5)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:32.643564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:32.695883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a566170d02204b25bf4635f9df2241d5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:32.703535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a566170d02204b25bf4635f9df2241d5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:32.716599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a566170d02204b25bf4635f9df2241d5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:32.717633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a566170d02204b25bf4635f9df2241d5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:32.726685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d8f33245-aae9-4ea7-b1d2-571c3b64b99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a566170d02204b25bf4635f9df2241d5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:32.740618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 908/1829] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:32 2022] DELETE /identity/v3/users/a566170d02204b25bf4635f9df2241d5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:33.057486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:33.059113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:33.073527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0fe09-909a-4739-869e-8a12f9c57794 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:33.136354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:33.137426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.137685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.137970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] PATH_INFO: `/v3/projects/f78e7d8f41e342eaae69c0fe57660716` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.139341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78e7d8f41e342eaae69c0fe57660716)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:33.141383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:33.193877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78e7d8f41e342eaae69c0fe57660716', 'request_id': 'req-38b2fe54-e814-4d41-8fc1-849440899db3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:33.200783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78e7d8f41e342eaae69c0fe57660716', 'request_id': 'req-38b2fe54-e814-4d41-8fc1-849440899db3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:33.207177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78e7d8f41e342eaae69c0fe57660716', 'request_id': 'req-38b2fe54-e814-4d41-8fc1-849440899db3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:33.221674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] The token cache is being invalidate because project f78e7d8f41e342eaae69c0fe57660716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:33.222820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:33.223538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-38b2fe54-e814-4d41-8fc1-849440899db3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:33.225147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 922/1830] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:33 2022] DELETE /identity/v3/projects/f78e7d8f41e342eaae69c0fe57660716 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:33.231117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e121f-805e-4ad7-b04a-c83b7b4bdeae None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.231389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e121f-805e-4ad7-b04a-c83b7b4bdeae None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.231660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e121f-805e-4ad7-b04a-c83b7b4bdeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.251276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f02e121f-805e-4ad7-b04a-c83b7b4bdeae None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:33.252630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f02e121f-805e-4ad7-b04a-c83b7b4bdeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:33.331897 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 909/1831] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:33.340441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b115d8-a839-4783-8cc6-8b1938aad65c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.340733 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b115d8-a839-4783-8cc6-8b1938aad65c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.341030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b115d8-a839-4783-8cc6-8b1938aad65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.361431 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-73b115d8-a839-4783-8cc6-8b1938aad65c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:33.362751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-73b115d8-a839-4783-8cc6-8b1938aad65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:33.372055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 923/1832] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:33.376710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e121f-805e-4ad7-b04a-c83b7b4bdeae None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:33.387064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e121f-805e-4ad7-b04a-c83b7b4bdeae None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:33.391940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c654f-6d69-434e-a745-8a9a2f56c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:33.392623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c654f-6d69-434e-a745-8a9a2f56c7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.392900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c654f-6d69-434e-a745-8a9a2f56c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.393172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c654f-6d69-434e-a745-8a9a2f56c7d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.393957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c654f-6d69-434e-a745-8a9a2f56c7d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:25:33.394267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c654f-6d69-434e-a745-8a9a2f56c7d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:33.395976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c654f-6d69-434e-a745-8a9a2f56c7d3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:33.409015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 910/1833] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:25:33.413618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b115d8-a839-4783-8cc6-8b1938aad65c None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:33.423821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b115d8-a839-4783-8cc6-8b1938aad65c None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:33.429668 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117dcf4-d865-4fa5-a9c4-bfda6e7fb6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:33.430362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117dcf4-d865-4fa5-a9c4-bfda6e7fb6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.430644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117dcf4-d865-4fa5-a9c4-bfda6e7fb6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.430920 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117dcf4-d865-4fa5-a9c4-bfda6e7fb6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.431670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117dcf4-d865-4fa5-a9c4-bfda6e7fb6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:33.433885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117dcf4-d865-4fa5-a9c4-bfda6e7fb6a1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:33.462668 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 924/1834] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:33 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:33.467541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c654f-6d69-434e-a745-8a9a2f56c7d3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:33.478442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c654f-6d69-434e-a745-8a9a2f56c7d3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:33.542798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd791d4f-0dc7-4648-b413-354b5414bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:33.543506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791d4f-0dc7-4648-b413-354b5414bbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.543787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791d4f-0dc7-4648-b413-354b5414bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.544024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd791d4f-0dc7-4648-b413-354b5414bbf2 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.544765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd791d4f-0dc7-4648-b413-354b5414bbf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:33.546755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd791d4f-0dc7-4648-b413-354b5414bbf2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:33.569711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 911/1835] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:33 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:33.574064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117dcf4-d865-4fa5-a9c4-bfda6e7fb6a1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:33.585541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117dcf4-d865-4fa5-a9c4-bfda6e7fb6a1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:33.591754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c63f72-6221-45c4-a597-7e4b25e1495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:33.592521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c63f72-6221-45c4-a597-7e4b25e1495f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.592836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c63f72-6221-45c4-a597-7e4b25e1495f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.593121 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c63f72-6221-45c4-a597-7e4b25e1495f admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.593936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c63f72-6221-45c4-a597-7e4b25e1495f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:33.595728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c63f72-6221-45c4-a597-7e4b25e1495f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:33.608552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 925/1836] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:33.613183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd791d4f-0dc7-4648-b413-354b5414bbf2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:33.624490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd791d4f-0dc7-4648-b413-354b5414bbf2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:33.630673 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3d2bb-aa2b-4c12-975a-848eb9c39b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:33.630793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3d2bb-aa2b-4c12-975a-848eb9c39b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.631044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3d2bb-aa2b-4c12-975a-848eb9c39b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.631315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3d2bb-aa2b-4c12-975a-848eb9c39b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.632075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3d2bb-aa2b-4c12-975a-848eb9c39b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:33.633723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3d2bb-aa2b-4c12-975a-848eb9c39b3b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:33.645246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 912/1837] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:33.649932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c63f72-6221-45c4-a597-7e4b25e1495f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:33.663161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c63f72-6221-45c4-a597-7e4b25e1495f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:33.669054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ede854-749a-4b3c-aa6e-ff073c621452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:33.670144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ede854-749a-4b3c-aa6e-ff073c621452 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.670434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ede854-749a-4b3c-aa6e-ff073c621452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.670724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ede854-749a-4b3c-aa6e-ff073c621452 admin admin] PATH_INFO: `/v3/projects/733733d4ea2a4d658db8ae56495668ae/users/72625441c8a74603ba507f281d46cdb4/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.693108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ede854-749a-4b3c-aa6e-ff073c621452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733733d4ea2a4d658db8ae56495668ae, user_id=72625441c8a74603ba507f281d46cdb4, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:33.698107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ede854-749a-4b3c-aa6e-ff073c621452 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:33.714642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 926/1838] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:33 2022] PUT /identity/v3/projects/733733d4ea2a4d658db8ae56495668ae/users/72625441c8a74603ba507f281d46cdb4/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:33.726995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23556223-e05e-43db-832d-582d4916b268 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.727585 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23556223-e05e-43db-832d-582d4916b268 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.728045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23556223-e05e-43db-832d-582d4916b268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.783070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-23556223-e05e-43db-832d-582d4916b268 None None] MFA Rules not processed for user `72625441c8a74603ba507f281d46cdb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:33.784329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-23556223-e05e-43db-832d-582d4916b268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:33.867548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 913/1839] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:33.868766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ede854-749a-4b3c-aa6e-ff073c621452 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:33.935311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ede854-749a-4b3c-aa6e-ff073c621452 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:33.941440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731c93-03d5-48d7-ad2d-25369bb7e582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:33.942114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731c93-03d5-48d7-ad2d-25369bb7e582 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:33.942397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731c93-03d5-48d7-ad2d-25369bb7e582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:33.942666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731c93-03d5-48d7-ad2d-25369bb7e582 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:33.943383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19731c93-03d5-48d7-ad2d-25369bb7e582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:33.945379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19731c93-03d5-48d7-ad2d-25369bb7e582 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:33.974211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 927/1840] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:33 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:33.978483 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23556223-e05e-43db-832d-582d4916b268 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:33.991946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23556223-e05e-43db-832d-582d4916b268 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:34.061700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11f0c0-b056-4ad7-860f-678d02419563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:34.062799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11f0c0-b056-4ad7-860f-678d02419563 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:34.063091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11f0c0-b056-4ad7-860f-678d02419563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:34.063368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11f0c0-b056-4ad7-860f-678d02419563 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:34.064438 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11f0c0-b056-4ad7-860f-678d02419563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:34.066565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11f0c0-b056-4ad7-860f-678d02419563 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:34.090758 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 914/1841] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:33 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:25:34.095835 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731c93-03d5-48d7-ad2d-25369bb7e582 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:34.108739 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731c93-03d5-48d7-ad2d-25369bb7e582 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:34.114125 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1899-97df-4bfb-8b78-7e9928d51bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:34.114806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1899-97df-4bfb-8b78-7e9928d51bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:34.115083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1899-97df-4bfb-8b78-7e9928d51bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:34.115351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e1899-97df-4bfb-8b78-7e9928d51bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:34.116751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e1899-97df-4bfb-8b78-7e9928d51bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:34.117862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e1899-97df-4bfb-8b78-7e9928d51bd9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:34.130633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 928/1842] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:34.136254 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11f0c0-b056-4ad7-860f-678d02419563 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:34.147960 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11f0c0-b056-4ad7-860f-678d02419563 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:34.153100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f39f70-8412-475d-b4de-5fbcbf13a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:34.154088 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f39f70-8412-475d-b4de-5fbcbf13a19b admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:34.154364 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f39f70-8412-475d-b4de-5fbcbf13a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:34.154629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f39f70-8412-475d-b4de-5fbcbf13a19b admin admin] PATH_INFO: `/v3/projects/e807f826588a43cbbfec8681f473e379/users/ca6cb1af0e204ddaab695d4e846f6f6d/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:34.172419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f39f70-8412-475d-b4de-5fbcbf13a19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e807f826588a43cbbfec8681f473e379, user_id=ca6cb1af0e204ddaab695d4e846f6f6d, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:34.175571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f39f70-8412-475d-b4de-5fbcbf13a19b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:34.191097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 915/1843] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:34 2022] PUT /identity/v3/projects/e807f826588a43cbbfec8681f473e379/users/ca6cb1af0e204ddaab695d4e846f6f6d/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:34.195544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1899-97df-4bfb-8b78-7e9928d51bd9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:34.206724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e1899-97df-4bfb-8b78-7e9928d51bd9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:34.299525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a574d2a-e7b9-4b13-992a-a692831d600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:34.300684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a574d2a-e7b9-4b13-992a-a692831d600a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:34.301189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a574d2a-e7b9-4b13-992a-a692831d600a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:34.301620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a574d2a-e7b9-4b13-992a-a692831d600a admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:34.303077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a574d2a-e7b9-4b13-992a-a692831d600a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:34.306458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a574d2a-e7b9-4b13-992a-a692831d600a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:34.326107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 929/1844] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:34.332644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f39f70-8412-475d-b4de-5fbcbf13a19b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:34.351189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f39f70-8412-475d-b4de-5fbcbf13a19b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:34.362948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c357b-4ecf-4947-a465-e6df3f1e1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:34.364466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c357b-4ecf-4947-a465-e6df3f1e1b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:34.364948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c357b-4ecf-4947-a465-e6df3f1e1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:34.365452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c357b-4ecf-4947-a465-e6df3f1e1b9c admin admin] PATH_INFO: `/v3/projects/e807f826588a43cbbfec8681f473e379/users/ca6cb1af0e204ddaab695d4e846f6f6d/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:34.368535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c357b-4ecf-4947-a465-e6df3f1e1b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e807f826588a43cbbfec8681f473e379, user_id=ca6cb1af0e204ddaab695d4e846f6f6d, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:34.371536 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c357b-4ecf-4947-a465-e6df3f1e1b9c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:34.384434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 916/1845] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:34 2022] PUT /identity/v3/projects/e807f826588a43cbbfec8681f473e379/users/ca6cb1af0e204ddaab695d4e846f6f6d/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:34.404964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1f83-a3e4-47e2-95f9-f03365f9f684 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:34.405370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1f83-a3e4-47e2-95f9-f03365f9f684 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:34.405822 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc1f83-a3e4-47e2-95f9-f03365f9f684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:34.489911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-f3dc1f83-a3e4-47e2-95f9-f03365f9f684 None None] MFA Rules not processed for user `ca6cb1af0e204ddaab695d4e846f6f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:34.491642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f3dc1f83-a3e4-47e2-95f9-f03365f9f684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:34.649284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 930/1846] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:34 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:34.661650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c357b-4ecf-4947-a465-e6df3f1e1b9c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:34.665312 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-748c357b-4ecf-4947-a465-e6df3f1e1b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:34.764583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c357b-4ecf-4947-a465-e6df3f1e1b9c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:34.770846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe3226-a1f7-4197-935b-a60bfe7fe21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:34.774068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe3226-a1f7-4197-935b-a60bfe7fe21f service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:34.774413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe3226-a1f7-4197-935b-a60bfe7fe21f service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:34.774776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe3226-a1f7-4197-935b-a60bfe7fe21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:34.787844 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe3226-a1f7-4197-935b-a60bfe7fe21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:34.789904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe3226-a1f7-4197-935b-a60bfe7fe21f service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:34.809349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 917/1847] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:37.953116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc1f83-a3e4-47e2-95f9-f03365f9f684 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:38.024930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc1f83-a3e4-47e2-95f9-f03365f9f684 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:38.030086 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:38.030957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:38.031229 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:38.031500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] PATH_INFO: `/v3/users/72625441c8a74603ba507f281d46cdb4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:38.032772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72625441c8a74603ba507f281d46cdb4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:38.034737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:38.083019 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72625441c8a74603ba507f281d46cdb4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:38.090426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72625441c8a74603ba507f281d46cdb4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:38.091152 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72625441c8a74603ba507f281d46cdb4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:38.098988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72625441c8a74603ba507f281d46cdb4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:38.110857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72625441c8a74603ba507f281d46cdb4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:38.116803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 931/1848] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:37 2022] DELETE /identity/v3/users/72625441c8a74603ba507f281d46cdb4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:38.121724 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c0403-6051-4e12-8c36-f4fc1694d84a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:38.122244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c0403-6051-4e12-8c36-f4fc1694d84a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:38.122244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c0403-6051-4e12-8c36-f4fc1694d84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:38.140019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-882c0403-6051-4e12-8c36-f4fc1694d84a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:38.141253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-882c0403-6051-4e12-8c36-f4fc1694d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:38.204191 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 918/1849] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:38.214149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:38.215681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:38.273563 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d8113-5375-4fb0-b506-468734fc8e28 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:38.277676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54773936-99a9-4e7f-8865-4563a70532fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:38.278379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773936-99a9-4e7f-8865-4563a70532fb service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:38.278627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773936-99a9-4e7f-8865-4563a70532fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:38.278960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54773936-99a9-4e7f-8865-4563a70532fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:38.291595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54773936-99a9-4e7f-8865-4563a70532fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:38.294397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54773936-99a9-4e7f-8865-4563a70532fb service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:38.308923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 932/1850] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:38.764180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c0403-6051-4e12-8c36-f4fc1694d84a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:38.765722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-882c0403-6051-4e12-8c36-f4fc1694d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:38.778543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c0403-6051-4e12-8c36-f4fc1694d84a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:38.783876 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:38.784991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:38.785295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:38.785612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] PATH_INFO: `/v3/projects/733733d4ea2a4d658db8ae56495668ae` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:38.787123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733733d4ea2a4d658db8ae56495668ae)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:38.789059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:38.837100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733733d4ea2a4d658db8ae56495668ae', 'request_id': 'req-ebf53bb7-6069-41de-a7d2-f660bea64dd0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:38.846247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733733d4ea2a4d658db8ae56495668ae', 'request_id': 'req-ebf53bb7-6069-41de-a7d2-f660bea64dd0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:38.854219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733733d4ea2a4d658db8ae56495668ae', 'request_id': 'req-ebf53bb7-6069-41de-a7d2-f660bea64dd0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:38.865681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] The token cache is being invalidate because project 733733d4ea2a4d658db8ae56495668ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:38.865973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:38.866669 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:38.868297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 919/1851] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:38 2022] DELETE /identity/v3/projects/733733d4ea2a4d658db8ae56495668ae => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:38.872663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54773936-99a9-4e7f-8865-4563a70532fb service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:38.884641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54773936-99a9-4e7f-8865-4563a70532fb service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:38.947645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:38.948539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:38.948829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:38.949096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] PATH_INFO: `/v3/users/ca6cb1af0e204ddaab695d4e846f6f6d` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:38.950667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6cb1af0e204ddaab695d4e846f6f6d)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:38.952826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:39.007146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6cb1af0e204ddaab695d4e846f6f6d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:39.014039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6cb1af0e204ddaab695d4e846f6f6d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:39.014769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6cb1af0e204ddaab695d4e846f6f6d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:39.023798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6cb1af0e204ddaab695d4e846f6f6d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:39.036053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21d9e72c-3e28-41d7-8f09-88a9a054ed02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6cb1af0e204ddaab695d4e846f6f6d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:39.045334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 933/1852] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:38 2022] DELETE /identity/v3/users/ca6cb1af0e204ddaab695d4e846f6f6d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:39.331758 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:39.333219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:39.348833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf53bb7-6069-41de-a7d2-f660bea64dd0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:39.408355 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:39.409247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:39.409532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:39.409799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] PATH_INFO: `/v3/projects/e807f826588a43cbbfec8681f473e379` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:39.411121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e807f826588a43cbbfec8681f473e379)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:39.413073 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:39.462479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e807f826588a43cbbfec8681f473e379', 'request_id': 'req-03fa7921-d31b-4657-92aa-ac03d74f546d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:39.470850 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e807f826588a43cbbfec8681f473e379', 'request_id': 'req-03fa7921-d31b-4657-92aa-ac03d74f546d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:39.479260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e807f826588a43cbbfec8681f473e379', 'request_id': 'req-03fa7921-d31b-4657-92aa-ac03d74f546d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:39.493624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] The token cache is being invalidate because project e807f826588a43cbbfec8681f473e379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:39.493911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:39.494583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03fa7921-d31b-4657-92aa-ac03d74f546d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:39.496282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 920/1853] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:39 2022] DELETE /identity/v3/projects/e807f826588a43cbbfec8681f473e379 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:39.503599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60125e-114b-4e55-91d1-839ac6669395 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:39.503879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60125e-114b-4e55-91d1-839ac6669395 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:39.504153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60125e-114b-4e55-91d1-839ac6669395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:39.528217 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ea60125e-114b-4e55-91d1-839ac6669395 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:39.529353 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ea60125e-114b-4e55-91d1-839ac6669395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:39.601146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 934/1854] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:39.603601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9331e7-6cab-4dc0-9cbe-4af09689221a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:39.603601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9331e7-6cab-4dc0-9cbe-4af09689221a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:39.604096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9331e7-6cab-4dc0-9cbe-4af09689221a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:39.644234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-cf9331e7-6cab-4dc0-9cbe-4af09689221a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:39.645528 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-cf9331e7-6cab-4dc0-9cbe-4af09689221a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:39.661851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 921/1855] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:39.662584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60125e-114b-4e55-91d1-839ac6669395 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:39.677663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60125e-114b-4e55-91d1-839ac6669395 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:39.682838 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6ff3-da1b-4b20-b3df-896d284dc94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:39.683346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6ff3-da1b-4b20-b3df-896d284dc94b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:39.683809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6ff3-da1b-4b20-b3df-896d284dc94b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:39.684146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6ff3-da1b-4b20-b3df-896d284dc94b admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:39.684950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6ff3-da1b-4b20-b3df-896d284dc94b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:25:39.685384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6ff3-da1b-4b20-b3df-896d284dc94b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:39.687353 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6ff3-da1b-4b20-b3df-896d284dc94b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:39.704572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 935/1856] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:25:39.705830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9331e7-6cab-4dc0-9cbe-4af09689221a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:39.715565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9331e7-6cab-4dc0-9cbe-4af09689221a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:39.720984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe5c14-4856-4939-a29b-1f513904a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:39.721827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe5c14-4856-4939-a29b-1f513904a85d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:39.722302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe5c14-4856-4939-a29b-1f513904a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:39.722583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe5c14-4856-4939-a29b-1f513904a85d admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:39.723298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe5c14-4856-4939-a29b-1f513904a85d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:39.725263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe5c14-4856-4939-a29b-1f513904a85d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:39.757753 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 922/1857] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:39 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:39.759067 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6ff3-da1b-4b20-b3df-896d284dc94b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:39.769749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6ff3-da1b-4b20-b3df-896d284dc94b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:39.825665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2806198-e735-4d0d-b32f-2554ac71043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:39.826218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2806198-e735-4d0d-b32f-2554ac71043b admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:39.826519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2806198-e735-4d0d-b32f-2554ac71043b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:39.826788 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2806198-e735-4d0d-b32f-2554ac71043b admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:39.827461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2806198-e735-4d0d-b32f-2554ac71043b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:39.829441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2806198-e735-4d0d-b32f-2554ac71043b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:39.853101 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 936/1858] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:39 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:39.856938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe5c14-4856-4939-a29b-1f513904a85d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:39.870210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe5c14-4856-4939-a29b-1f513904a85d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:39.875347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485f8d2-5a29-4035-bb97-50311d9bbec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:39.876018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f8d2-5a29-4035-bb97-50311d9bbec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:39.876293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f8d2-5a29-4035-bb97-50311d9bbec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:39.876564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f8d2-5a29-4035-bb97-50311d9bbec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:39.877331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485f8d2-5a29-4035-bb97-50311d9bbec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:39.878977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485f8d2-5a29-4035-bb97-50311d9bbec9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:39.890378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 923/1859] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:39.894516 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2806198-e735-4d0d-b32f-2554ac71043b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:39.906554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2806198-e735-4d0d-b32f-2554ac71043b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:39.912728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2de2ce-1430-481a-85dd-dbdfaeae96b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:39.913543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2de2ce-1430-481a-85dd-dbdfaeae96b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:39.913825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2de2ce-1430-481a-85dd-dbdfaeae96b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:39.914094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2de2ce-1430-481a-85dd-dbdfaeae96b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:39.914884 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2de2ce-1430-481a-85dd-dbdfaeae96b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:39.916629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2de2ce-1430-481a-85dd-dbdfaeae96b2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:39.928558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 937/1860] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:39.933206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485f8d2-5a29-4035-bb97-50311d9bbec9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:39.944272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485f8d2-5a29-4035-bb97-50311d9bbec9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:39.949897 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68297cdb-2aca-4b9b-83fc-ee1a7430bfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:39.950831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68297cdb-2aca-4b9b-83fc-ee1a7430bfee admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:39.951110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68297cdb-2aca-4b9b-83fc-ee1a7430bfee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:39.951383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68297cdb-2aca-4b9b-83fc-ee1a7430bfee admin admin] PATH_INFO: `/v3/projects/06f7999fc69746fa9d457e04a5d2f5b1/users/7e8e381bac1446bf9b9a03f9931d08f4/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:39.967891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68297cdb-2aca-4b9b-83fc-ee1a7430bfee admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f7999fc69746fa9d457e04a5d2f5b1, user_id=7e8e381bac1446bf9b9a03f9931d08f4, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:39.970651 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68297cdb-2aca-4b9b-83fc-ee1a7430bfee admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:39.988297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 924/1861] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:39 2022] PUT /identity/v3/projects/06f7999fc69746fa9d457e04a5d2f5b1/users/7e8e381bac1446bf9b9a03f9931d08f4/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:39.999324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecc8e7-6ffd-4f6e-b57e-80b0e628704b None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:39.999707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecc8e7-6ffd-4f6e-b57e-80b0e628704b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:40.000166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecc8e7-6ffd-4f6e-b57e-80b0e628704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:40.030614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ffecc8e7-6ffd-4f6e-b57e-80b0e628704b None None] MFA Rules not processed for user `7e8e381bac1446bf9b9a03f9931d08f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:40.031965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ffecc8e7-6ffd-4f6e-b57e-80b0e628704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:40.123343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 938/1862] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:40.129940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68297cdb-2aca-4b9b-83fc-ee1a7430bfee admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:40.240527 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68297cdb-2aca-4b9b-83fc-ee1a7430bfee admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:40.248982 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc81f-7fe7-4215-912d-9e4a9c5599fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:40.250102 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc81f-7fe7-4215-912d-9e4a9c5599fd admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:40.250546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc81f-7fe7-4215-912d-9e4a9c5599fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:40.250965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc81f-7fe7-4215-912d-9e4a9c5599fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:40.252155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cc81f-7fe7-4215-912d-9e4a9c5599fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:40.256812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cc81f-7fe7-4215-912d-9e4a9c5599fd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:40.301145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 925/1863] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:40 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:40.305554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecc8e7-6ffd-4f6e-b57e-80b0e628704b None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:40.336599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecc8e7-6ffd-4f6e-b57e-80b0e628704b None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:40.490801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eda935-3416-46cd-a647-2fe5c2394a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:40.492636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eda935-3416-46cd-a647-2fe5c2394a2d admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:40.493648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eda935-3416-46cd-a647-2fe5c2394a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:40.496521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eda935-3416-46cd-a647-2fe5c2394a2d admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:40.497740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eda935-3416-46cd-a647-2fe5c2394a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:40.512939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eda935-3416-46cd-a647-2fe5c2394a2d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:40.554041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 939/1864] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:40 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:25:40.558116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc81f-7fe7-4215-912d-9e4a9c5599fd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:40.570305 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc81f-7fe7-4215-912d-9e4a9c5599fd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:40.575618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64f7d3-34a6-490c-a9b4-d1723558deba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:40.576433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64f7d3-34a6-490c-a9b4-d1723558deba admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:40.576986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64f7d3-34a6-490c-a9b4-d1723558deba admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:40.577357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64f7d3-34a6-490c-a9b4-d1723558deba admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:40.578323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64f7d3-34a6-490c-a9b4-d1723558deba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:40.581047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64f7d3-34a6-490c-a9b4-d1723558deba admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:40.599060 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eda935-3416-46cd-a647-2fe5c2394a2d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:40.605461 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 926/1865] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:40.613193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eda935-3416-46cd-a647-2fe5c2394a2d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:40.619632 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b0e7e-2d9c-4e79-8052-d708328417e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:40.620651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b0e7e-2d9c-4e79-8052-d708328417e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:40.621040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b0e7e-2d9c-4e79-8052-d708328417e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:40.621420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b0e7e-2d9c-4e79-8052-d708328417e3 admin admin] PATH_INFO: `/v3/projects/adbef854a8a046a4b94a5a4d2f011d08/users/c53a4b72fbf542f7be41476e00f26299/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:40.649161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b0e7e-2d9c-4e79-8052-d708328417e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbef854a8a046a4b94a5a4d2f011d08, user_id=c53a4b72fbf542f7be41476e00f26299, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:40.652956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b0e7e-2d9c-4e79-8052-d708328417e3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:40.686052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 940/1866] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:40 2022] PUT /identity/v3/projects/adbef854a8a046a4b94a5a4d2f011d08/users/c53a4b72fbf542f7be41476e00f26299/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:40.692901 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64f7d3-34a6-490c-a9b4-d1723558deba admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:40.727567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64f7d3-34a6-490c-a9b4-d1723558deba admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:40.834190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8219f-76ff-401c-96b0-199745ca1ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:40.835158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8219f-76ff-401c-96b0-199745ca1ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:40.835595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8219f-76ff-401c-96b0-199745ca1ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:40.835959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8219f-76ff-401c-96b0-199745ca1ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:40.836961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8219f-76ff-401c-96b0-199745ca1ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:40.838953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8219f-76ff-401c-96b0-199745ca1ff5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:40.854547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 927/1867] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:40.859359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b0e7e-2d9c-4e79-8052-d708328417e3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:40.874075 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b0e7e-2d9c-4e79-8052-d708328417e3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:40.894435 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d2a9b-2a8c-4ea0-b540-3647a6a9d6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:40.895652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d2a9b-2a8c-4ea0-b540-3647a6a9d6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:40.896080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d2a9b-2a8c-4ea0-b540-3647a6a9d6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:40.897687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d2a9b-2a8c-4ea0-b540-3647a6a9d6d2 admin admin] PATH_INFO: `/v3/projects/adbef854a8a046a4b94a5a4d2f011d08/users/c53a4b72fbf542f7be41476e00f26299/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:40.899829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d2a9b-2a8c-4ea0-b540-3647a6a9d6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adbef854a8a046a4b94a5a4d2f011d08, user_id=c53a4b72fbf542f7be41476e00f26299, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:40.911564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d2a9b-2a8c-4ea0-b540-3647a6a9d6d2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:40.972460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 941/1868] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:40 2022] PUT /identity/v3/projects/adbef854a8a046a4b94a5a4d2f011d08/users/c53a4b72fbf542f7be41476e00f26299/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:40.975535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cfa57-8041-4ac9-8afa-21ae8586d430 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:40.976216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cfa57-8041-4ac9-8afa-21ae8586d430 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:40.976552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cfa57-8041-4ac9-8afa-21ae8586d430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:41.051740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-418cfa57-8041-4ac9-8afa-21ae8586d430 None None] MFA Rules not processed for user `c53a4b72fbf542f7be41476e00f26299`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:41.053148 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-418cfa57-8041-4ac9-8afa-21ae8586d430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:41.267283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 928/1869] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:41.384473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d2a9b-2a8c-4ea0-b540-3647a6a9d6d2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:41.387587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f60d2a9b-2a8c-4ea0-b540-3647a6a9d6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:41.622446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d2a9b-2a8c-4ea0-b540-3647a6a9d6d2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:41.628514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926f0dc-911b-4f7a-be51-97b0a4c241dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:41.631039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926f0dc-911b-4f7a-be51-97b0a4c241dd service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:41.631355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926f0dc-911b-4f7a-be51-97b0a4c241dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:41.631796 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926f0dc-911b-4f7a-be51-97b0a4c241dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:41.651631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926f0dc-911b-4f7a-be51-97b0a4c241dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:41.653304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926f0dc-911b-4f7a-be51-97b0a4c241dd service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:41.672754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 942/1870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:41.716108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cfa57-8041-4ac9-8afa-21ae8586d430 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:41.845176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cfa57-8041-4ac9-8afa-21ae8586d430 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:41.852449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:41.853864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:41.854314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:41.854763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] PATH_INFO: `/v3/users/7e8e381bac1446bf9b9a03f9931d08f4` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:41.857001 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8e381bac1446bf9b9a03f9931d08f4)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:41.860191 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:41.951062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8e381bac1446bf9b9a03f9931d08f4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:41.960247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8e381bac1446bf9b9a03f9931d08f4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:41.979252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8e381bac1446bf9b9a03f9931d08f4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:41.985955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8e381bac1446bf9b9a03f9931d08f4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:42.000204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8e381bac1446bf9b9a03f9931d08f4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:42.009189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 929/1871] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:41 2022] DELETE /identity/v3/users/7e8e381bac1446bf9b9a03f9931d08f4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:42.013836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cd734-fbf6-453d-bfc8-d6b6ada2a4b7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:42.014129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cd734-fbf6-453d-bfc8-d6b6ada2a4b7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:42.014408 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cd734-fbf6-453d-bfc8-d6b6ada2a4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:42.035719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-cb8cd734-fbf6-453d-bfc8-d6b6ada2a4b7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:42.037103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-cb8cd734-fbf6-453d-bfc8-d6b6ada2a4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:42.148639 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 943/1872] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:42.160865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:42.162665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:42.266307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2039b-5e0e-4621-b911-d76a6e3d675d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:42.271371 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c19b-e562-4eb4-a9e6-f8145c252fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:42.272042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c19b-e562-4eb4-a9e6-f8145c252fff service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:42.272315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c19b-e562-4eb4-a9e6-f8145c252fff service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:42.272581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c19b-e562-4eb4-a9e6-f8145c252fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:42.290086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369c19b-e562-4eb4-a9e6-f8145c252fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:42.291749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369c19b-e562-4eb4-a9e6-f8145c252fff service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:42.311988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 930/1873] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:42.786017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cd734-fbf6-453d-bfc8-d6b6ada2a4b7 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:42.789072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-cb8cd734-fbf6-453d-bfc8-d6b6ada2a4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:42.827783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cd734-fbf6-453d-bfc8-d6b6ada2a4b7 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:42.858574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:42.860346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:42.861375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:42.864085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] PATH_INFO: `/v3/projects/06f7999fc69746fa9d457e04a5d2f5b1` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:42.869720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f7999fc69746fa9d457e04a5d2f5b1)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:42.875660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:42.967984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f7999fc69746fa9d457e04a5d2f5b1', 'request_id': 'req-ca5fa46a-cf2b-4f56-815c-0770ccd27388'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:42.983741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f7999fc69746fa9d457e04a5d2f5b1', 'request_id': 'req-ca5fa46a-cf2b-4f56-815c-0770ccd27388'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:43.015246 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f7999fc69746fa9d457e04a5d2f5b1', 'request_id': 'req-ca5fa46a-cf2b-4f56-815c-0770ccd27388'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:43.063459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] The token cache is being invalidate because project 06f7999fc69746fa9d457e04a5d2f5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:43.063951 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:43.065442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:43.068526 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 944/1874] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:42 2022] DELETE /identity/v3/projects/06f7999fc69746fa9d457e04a5d2f5b1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:43.076150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c19b-e562-4eb4-a9e6-f8145c252fff service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:43.098825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c19b-e562-4eb4-a9e6-f8145c252fff service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:43.206465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:43.207790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:43.208128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:43.208424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] PATH_INFO: `/v3/users/c53a4b72fbf542f7be41476e00f26299` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:43.210557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53a4b72fbf542f7be41476e00f26299)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:43.212462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:43.350495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53a4b72fbf542f7be41476e00f26299'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:43.364474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53a4b72fbf542f7be41476e00f26299'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:43.401724 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53a4b72fbf542f7be41476e00f26299'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:43.402721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53a4b72fbf542f7be41476e00f26299'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:43.422429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b24c7bff-e6b6-4ee1-952d-b6c81d6e2ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53a4b72fbf542f7be41476e00f26299'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:43.433538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 931/1875] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:43 2022] DELETE /identity/v3/users/c53a4b72fbf542f7be41476e00f26299 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:43.944409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:43.946346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:43.962911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fa46a-cf2b-4f56-815c-0770ccd27388 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:44.042136 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:44.043078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.043351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.043628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] PATH_INFO: `/v3/projects/adbef854a8a046a4b94a5a4d2f011d08` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.045075 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=adbef854a8a046a4b94a5a4d2f011d08)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:44.047058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:44.098638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adbef854a8a046a4b94a5a4d2f011d08', 'request_id': 'req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:44.105750 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adbef854a8a046a4b94a5a4d2f011d08', 'request_id': 'req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:44.112498 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adbef854a8a046a4b94a5a4d2f011d08', 'request_id': 'req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:44.128031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] The token cache is being invalidate because project adbef854a8a046a4b94a5a4d2f011d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:44.128323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:44.129015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ca9bb5d7-a4d3-4e57-85a6-246b3c4558cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:44.130638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 945/1876] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:43 2022] DELETE /identity/v3/projects/adbef854a8a046a4b94a5a4d2f011d08 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:44.140231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ef669-7dbe-424e-b513-6152f4217f8f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.140231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ef669-7dbe-424e-b513-6152f4217f8f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.140231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ef669-7dbe-424e-b513-6152f4217f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.159149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-752ef669-7dbe-424e-b513-6152f4217f8f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:44.160379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-752ef669-7dbe-424e-b513-6152f4217f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:44.228493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 932/1877] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:44.238221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf74cec-cab7-4b56-a527-b3583e3825a2 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.238515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf74cec-cab7-4b56-a527-b3583e3825a2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.238766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf74cec-cab7-4b56-a527-b3583e3825a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.260969 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-acf74cec-cab7-4b56-a527-b3583e3825a2 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:44.262402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-acf74cec-cab7-4b56-a527-b3583e3825a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:44.271489 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 946/1878] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:44.276094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ef669-7dbe-424e-b513-6152f4217f8f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:44.286914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ef669-7dbe-424e-b513-6152f4217f8f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:44.292731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379a523-c93b-42a3-af78-52e541ae10e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:44.293523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379a523-c93b-42a3-af78-52e541ae10e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.293810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379a523-c93b-42a3-af78-52e541ae10e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.294087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379a523-c93b-42a3-af78-52e541ae10e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.294857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379a523-c93b-42a3-af78-52e541ae10e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:25:44.295162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379a523-c93b-42a3-af78-52e541ae10e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:44.296805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379a523-c93b-42a3-af78-52e541ae10e2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:44.310365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 933/1879] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:25:44.315286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf74cec-cab7-4b56-a527-b3583e3825a2 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:44.325443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf74cec-cab7-4b56-a527-b3583e3825a2 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:44.332247 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1e81a-fc2a-4877-acb1-0a7cde1b340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:44.333053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e81a-fc2a-4877-acb1-0a7cde1b340e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.333441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e81a-fc2a-4877-acb1-0a7cde1b340e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.334120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e81a-fc2a-4877-acb1-0a7cde1b340e admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.334932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1e81a-fc2a-4877-acb1-0a7cde1b340e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:44.337073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1e81a-fc2a-4877-acb1-0a7cde1b340e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:44.367653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 947/1880] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:44 2022] POST /identity/v3/projects => generated 359 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:44.372311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379a523-c93b-42a3-af78-52e541ae10e2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:44.382886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379a523-c93b-42a3-af78-52e541ae10e2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:44.449981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e95fc3-60bc-4893-9885-e7ffd8bfb326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:44.450446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e95fc3-60bc-4893-9885-e7ffd8bfb326 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.450748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e95fc3-60bc-4893-9885-e7ffd8bfb326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.450983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e95fc3-60bc-4893-9885-e7ffd8bfb326 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.451728 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e95fc3-60bc-4893-9885-e7ffd8bfb326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:44.453681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e95fc3-60bc-4893-9885-e7ffd8bfb326 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:44.478645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 934/1881] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:44 2022] POST /identity/v3/users => generated 280 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:44.483840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1e81a-fc2a-4877-acb1-0a7cde1b340e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:44.506600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1e81a-fc2a-4877-acb1-0a7cde1b340e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:44.511922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093449c-7e1d-426d-aa96-e07b9b43bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:44.512707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093449c-7e1d-426d-aa96-e07b9b43bf52 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.513112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093449c-7e1d-426d-aa96-e07b9b43bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.513617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093449c-7e1d-426d-aa96-e07b9b43bf52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.514513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093449c-7e1d-426d-aa96-e07b9b43bf52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:44.516338 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093449c-7e1d-426d-aa96-e07b9b43bf52 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:44.529925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 948/1882] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:44.534546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e95fc3-60bc-4893-9885-e7ffd8bfb326 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:44.545074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e95fc3-60bc-4893-9885-e7ffd8bfb326 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:44.549855 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acee71-bfba-4660-88a0-b7c2c2bbb739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:44.550533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acee71-bfba-4660-88a0-b7c2c2bbb739 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.550805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acee71-bfba-4660-88a0-b7c2c2bbb739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.551076 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acee71-bfba-4660-88a0-b7c2c2bbb739 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.551819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acee71-bfba-4660-88a0-b7c2c2bbb739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:44.553481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acee71-bfba-4660-88a0-b7c2c2bbb739 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:44.564392 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 935/1883] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:44.568671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093449c-7e1d-426d-aa96-e07b9b43bf52 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:44.580380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093449c-7e1d-426d-aa96-e07b9b43bf52 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:44.586144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d243-936a-4e61-a62d-7d4f6e32c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:44.587156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d243-936a-4e61-a62d-7d4f6e32c9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.587506 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d243-936a-4e61-a62d-7d4f6e32c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.587849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d243-936a-4e61-a62d-7d4f6e32c9e4 admin admin] PATH_INFO: `/v3/projects/64cd79c7d17e4db8811c0ee7f8abcadf/users/826e25d8f214444981127843a29bb608/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.606160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02d243-936a-4e61-a62d-7d4f6e32c9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64cd79c7d17e4db8811c0ee7f8abcadf, user_id=826e25d8f214444981127843a29bb608, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:44.609130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02d243-936a-4e61-a62d-7d4f6e32c9e4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:44.633500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 949/1884] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:44 2022] PUT /identity/v3/projects/64cd79c7d17e4db8811c0ee7f8abcadf/users/826e25d8f214444981127843a29bb608/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:44.636385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c089a40-9a6c-43ff-b89a-dea8e6be1cfd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.636746 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c089a40-9a6c-43ff-b89a-dea8e6be1cfd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.637005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c089a40-9a6c-43ff-b89a-dea8e6be1cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.666164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8c089a40-9a6c-43ff-b89a-dea8e6be1cfd None None] MFA Rules not processed for user `826e25d8f214444981127843a29bb608`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:44.667413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8c089a40-9a6c-43ff-b89a-dea8e6be1cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:44.741916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 936/1885] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:44.774100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d243-936a-4e61-a62d-7d4f6e32c9e4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:44.777696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0e02d243-936a-4e61-a62d-7d4f6e32c9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:44.856409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d243-936a-4e61-a62d-7d4f6e32c9e4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:44.860209 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aff04-25ad-4e75-a065-291da0b89479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:44.860865 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aff04-25ad-4e75-a065-291da0b89479 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.861144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aff04-25ad-4e75-a065-291da0b89479 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.861650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aff04-25ad-4e75-a065-291da0b89479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.870707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aff04-25ad-4e75-a065-291da0b89479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:44.872244 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aff04-25ad-4e75-a065-291da0b89479 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:44.882596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 950/1886] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:25:44.900411 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c089a40-9a6c-43ff-b89a-dea8e6be1cfd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:44.965378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c089a40-9a6c-43ff-b89a-dea8e6be1cfd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:44.972561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:44.973554 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:44.973832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:44.974105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] PATH_INFO: `/v3/users/826e25d8f214444981127843a29bb608` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:44.975348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] RBAC: Authorizing `identity:delete_user(user_id=826e25d8f214444981127843a29bb608)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:44.977308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:45.032946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826e25d8f214444981127843a29bb608'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:45.039747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826e25d8f214444981127843a29bb608'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:45.052638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826e25d8f214444981127843a29bb608'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:45.053403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826e25d8f214444981127843a29bb608'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:45.062470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826e25d8f214444981127843a29bb608'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:45.069457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 937/1887] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:44 2022] DELETE /identity/v3/users/826e25d8f214444981127843a29bb608 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:45.075219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe455-4516-444b-ba56-a5b52ebaba3d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:45.075718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe455-4516-444b-ba56-a5b52ebaba3d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:45.076374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe455-4516-444b-ba56-a5b52ebaba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:45.103573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-3c4fe455-4516-444b-ba56-a5b52ebaba3d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:45.104914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3c4fe455-4516-444b-ba56-a5b52ebaba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:45.179124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 951/1888] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:45.189454 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:45.191051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:45.265672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d519c-7dbe-45a9-85a9-8e528f88629c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:45.270460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b1d18-aadf-4bc0-9692-e839ca5a6412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:45.271116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b1d18-aadf-4bc0-9692-e839ca5a6412 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:45.271394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b1d18-aadf-4bc0-9692-e839ca5a6412 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:45.271695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b1d18-aadf-4bc0-9692-e839ca5a6412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:45.283299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b1d18-aadf-4bc0-9692-e839ca5a6412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:45.284793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b1d18-aadf-4bc0-9692-e839ca5a6412 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:45.296346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 938/1889] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:45.591446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe455-4516-444b-ba56-a5b52ebaba3d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:45.593042 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3c4fe455-4516-444b-ba56-a5b52ebaba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:45.606418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe455-4516-444b-ba56-a5b52ebaba3d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:45.613524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:45.614542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:45.614823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:45.615096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] PATH_INFO: `/v3/projects/64cd79c7d17e4db8811c0ee7f8abcadf` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:45.624043 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64cd79c7d17e4db8811c0ee7f8abcadf)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:45.626161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:45.674121 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64cd79c7d17e4db8811c0ee7f8abcadf', 'request_id': 'req-df3fe01d-36ca-40c2-b67d-55a38f029d41'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:45.681527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64cd79c7d17e4db8811c0ee7f8abcadf', 'request_id': 'req-df3fe01d-36ca-40c2-b67d-55a38f029d41'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:45.690550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64cd79c7d17e4db8811c0ee7f8abcadf', 'request_id': 'req-df3fe01d-36ca-40c2-b67d-55a38f029d41'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:45.711636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] The token cache is being invalidate because project 64cd79c7d17e4db8811c0ee7f8abcadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:45.712307 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:45.713333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-df3fe01d-36ca-40c2-b67d-55a38f029d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:45.725359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 952/1890] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:45 2022] DELETE /identity/v3/projects/64cd79c7d17e4db8811c0ee7f8abcadf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:47.147291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd337a5-eba9-4f6e-899c-c4f7aa7fb2a3 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:47.147866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd337a5-eba9-4f6e-899c-c4f7aa7fb2a3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:47.147866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd337a5-eba9-4f6e-899c-c4f7aa7fb2a3 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:47.150324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 939/1891] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jan 28 01:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:25:47.316977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eac86-bde6-4139-aba5-cb8d2cfd5116 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:47.317864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eac86-bde6-4139-aba5-cb8d2cfd5116 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:47.318158 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eac86-bde6-4139-aba5-cb8d2cfd5116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:47.350614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-989eac86-bde6-4139-aba5-cb8d2cfd5116 None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:47.352161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-989eac86-bde6-4139-aba5-cb8d2cfd5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:47.447900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 953/1892] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jan 28 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:47.538516 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd337a5-eba9-4f6e-899c-c4f7aa7fb2a3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:47.540469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5bd337a5-eba9-4f6e-899c-c4f7aa7fb2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:47.575420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd337a5-eba9-4f6e-899c-c4f7aa7fb2a3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:47.582457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf27cc-274d-4d3c-b872-528def67e1fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:47.583117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf27cc-274d-4d3c-b872-528def67e1fc service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:47.583924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf27cc-274d-4d3c-b872-528def67e1fc service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:47.584337 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf27cc-274d-4d3c-b872-528def67e1fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:47.598170 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf27cc-274d-4d3c-b872-528def67e1fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:47.600399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf27cc-274d-4d3c-b872-528def67e1fc service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:47.623200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 940/1893] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:25:55.512069 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eac86-bde6-4139-aba5-cb8d2cfd5116 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:55.514758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-989eac86-bde6-4139-aba5-cb8d2cfd5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:55.583044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eac86-bde6-4139-aba5-cb8d2cfd5116 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:55.588452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:55.589321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:55.589645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:55.589943 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] PATH_INFO: `/v3/users/f3653669c96843c3b6edd44b541fee00` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:55.591333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3653669c96843c3b6edd44b541fee00)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:55.593262 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:55.646262 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3653669c96843c3b6edd44b541fee00'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:55.653752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3653669c96843c3b6edd44b541fee00'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:55.654960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3653669c96843c3b6edd44b541fee00'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:55.663372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3653669c96843c3b6edd44b541fee00'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:55.679473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3653669c96843c3b6edd44b541fee00'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:55.685802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 954/1894] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:55 2022] DELETE /identity/v3/users/f3653669c96843c3b6edd44b541fee00 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:55.863181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf27cc-274d-4d3c-b872-528def67e1fc service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:55.874043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf27cc-274d-4d3c-b872-528def67e1fc service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:55.935178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:55.935178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:55.935509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:55.935509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] PATH_INFO: `/v3/projects/992f508ada3d41b0a0022ca24be349f6` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:55.936740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=992f508ada3d41b0a0022ca24be349f6)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:55.938680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:55.986064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992f508ada3d41b0a0022ca24be349f6', 'request_id': 'req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:55.994176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992f508ada3d41b0a0022ca24be349f6', 'request_id': 'req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.001763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992f508ada3d41b0a0022ca24be349f6', 'request_id': 'req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.014076 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] The token cache is being invalidate because project 992f508ada3d41b0a0022ca24be349f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:56.014371 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.015010 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.016824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 941/1895] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:55 2022] DELETE /identity/v3/projects/992f508ada3d41b0a0022ca24be349f6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:56.020864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:56.022837 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:56.038132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24b304-5877-47a3-8e41-37c5f06c4242 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:56.095945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:56.096846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:56.097109 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:56.097404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] PATH_INFO: `/v3/users/7fd3428820c341ff9665152c17192b6f` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:56.098736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd3428820c341ff9665152c17192b6f)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:56.100678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:56.152250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd3428820c341ff9665152c17192b6f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.158934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd3428820c341ff9665152c17192b6f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.159645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd3428820c341ff9665152c17192b6f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.168221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd3428820c341ff9665152c17192b6f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.181445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9560efe8-9e5d-40c1-8ccf-e6e22056279a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd3428820c341ff9665152c17192b6f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.187927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 955/1896] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:25:56 2022] DELETE /identity/v3/users/7fd3428820c341ff9665152c17192b6f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:25:56.371739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:56.374064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:56.398884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f222c-a3f7-4375-83a4-e46e05b1a5e8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:56.466616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:56.467442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:56.467722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:56.467989 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] PATH_INFO: `/v3/projects/6fdb64f5377e4a72aa4f9fd11f1d1734` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:56.469356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fdb64f5377e4a72aa4f9fd11f1d1734)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:56.471312 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:56.538095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fdb64f5377e4a72aa4f9fd11f1d1734', 'request_id': 'req-3a49a09d-58c0-46d6-8a55-7aac9cddda23'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.551273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fdb64f5377e4a72aa4f9fd11f1d1734', 'request_id': 'req-3a49a09d-58c0-46d6-8a55-7aac9cddda23'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.562864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fdb64f5377e4a72aa4f9fd11f1d1734', 'request_id': 'req-3a49a09d-58c0-46d6-8a55-7aac9cddda23'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.582325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] The token cache is being invalidate because project 6fdb64f5377e4a72aa4f9fd11f1d1734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:25:56.582721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.583959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3a49a09d-58c0-46d6-8a55-7aac9cddda23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:25:56.586147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 942/1897] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:25:56 2022] DELETE /identity/v3/projects/6fdb64f5377e4a72aa4f9fd11f1d1734 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:56.593532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4ca88-ed41-42d2-b9d3-e1cd201f1e89 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:56.594378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4ca88-ed41-42d2-b9d3-e1cd201f1e89 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:56.594378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4ca88-ed41-42d2-b9d3-e1cd201f1e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:56.616399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-13f4ca88-ed41-42d2-b9d3-e1cd201f1e89 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:56.617659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-13f4ca88-ed41-42d2-b9d3-e1cd201f1e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:56.703196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 956/1898] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:25:56.718233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615d85-b4ab-4858-b9df-b645411283e4 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:56.718615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615d85-b4ab-4858-b9df-b645411283e4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:56.719091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615d85-b4ab-4858-b9df-b645411283e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:56.748243 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-16615d85-b4ab-4858-b9df-b645411283e4 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:56.750233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-16615d85-b4ab-4858-b9df-b645411283e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:56.761403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 943/1899] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:56.766668 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4ca88-ed41-42d2-b9d3-e1cd201f1e89 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:56.783408 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4ca88-ed41-42d2-b9d3-e1cd201f1e89 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:56.790192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4b3b3-d72b-4b6b-89ac-26550f67e4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:56.791000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4b3b3-d72b-4b6b-89ac-26550f67e4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:56.791278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4b3b3-d72b-4b6b-89ac-26550f67e4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:56.791554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4b3b3-d72b-4b6b-89ac-26550f67e4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:56.792308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4b3b3-d72b-4b6b-89ac-26550f67e4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:25:56.792630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4b3b3-d72b-4b6b-89ac-26550f67e4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:56.794317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4b3b3-d72b-4b6b-89ac-26550f67e4a9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:56.816113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 957/1900] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:25:56.824292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615d85-b4ab-4858-b9df-b645411283e4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:56.839944 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615d85-b4ab-4858-b9df-b645411283e4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:56.847354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b9afd-502c-4b9b-95ba-640edb359dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:56.848338 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b9afd-502c-4b9b-95ba-640edb359dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:56.848592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b9afd-502c-4b9b-95ba-640edb359dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:56.848979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b9afd-502c-4b9b-95ba-640edb359dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:56.850105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b9afd-502c-4b9b-95ba-640edb359dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:56.853277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b9afd-502c-4b9b-95ba-640edb359dc4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:56.895293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 944/1901] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:25:56 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:25:56.900519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4b3b3-d72b-4b6b-89ac-26550f67e4a9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:56.911606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4b3b3-d72b-4b6b-89ac-26550f67e4a9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:56.978684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aac76-8835-4fe5-8e98-a4d5effeab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:56.979722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aac76-8835-4fe5-8e98-a4d5effeab70 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:56.980794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aac76-8835-4fe5-8e98-a4d5effeab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:56.980794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aac76-8835-4fe5-8e98-a4d5effeab70 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:56.982338 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10aac76-8835-4fe5-8e98-a4d5effeab70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:56.986183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10aac76-8835-4fe5-8e98-a4d5effeab70 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:57.017306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 958/1902] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:25:56 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:25:57.023175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b9afd-502c-4b9b-95ba-640edb359dc4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:57.036429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b9afd-502c-4b9b-95ba-640edb359dc4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:57.041182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1329fa5-fbe0-4c64-8983-ae52e57dc0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:57.041888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1329fa5-fbe0-4c64-8983-ae52e57dc0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:57.042164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1329fa5-fbe0-4c64-8983-ae52e57dc0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:57.042430 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1329fa5-fbe0-4c64-8983-ae52e57dc0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:57.043271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1329fa5-fbe0-4c64-8983-ae52e57dc0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:57.045154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1329fa5-fbe0-4c64-8983-ae52e57dc0a3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:57.056401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 945/1903] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:57.060911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aac76-8835-4fe5-8e98-a4d5effeab70 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:57.071564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aac76-8835-4fe5-8e98-a4d5effeab70 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:57.076600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669268f-1375-409a-87eb-ff95cb9fa374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:57.077377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669268f-1375-409a-87eb-ff95cb9fa374 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:57.077590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669268f-1375-409a-87eb-ff95cb9fa374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:57.077859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669268f-1375-409a-87eb-ff95cb9fa374 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:57.078603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669268f-1375-409a-87eb-ff95cb9fa374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:57.080218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669268f-1375-409a-87eb-ff95cb9fa374 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:57.091310 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 959/1904] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:25:57.095763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1329fa5-fbe0-4c64-8983-ae52e57dc0a3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:57.106423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1329fa5-fbe0-4c64-8983-ae52e57dc0a3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:57.111960 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1336-ffbb-4ab8-aaf8-f5cbd7fcca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:57.112857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1336-ffbb-4ab8-aaf8-f5cbd7fcca24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:57.113135 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1336-ffbb-4ab8-aaf8-f5cbd7fcca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:57.113448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1336-ffbb-4ab8-aaf8-f5cbd7fcca24 admin admin] PATH_INFO: `/v3/projects/ee2efde1a5584fd7bb7f97ba1cb8436a/users/6b8c4242239d4ec1b821f26b335f7cdb/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:57.129620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b1336-ffbb-4ab8-aaf8-f5cbd7fcca24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2efde1a5584fd7bb7f97ba1cb8436a, user_id=6b8c4242239d4ec1b821f26b335f7cdb, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:57.132280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b1336-ffbb-4ab8-aaf8-f5cbd7fcca24 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:57.148259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 946/1905] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:25:57 2022] PUT /identity/v3/projects/ee2efde1a5584fd7bb7f97ba1cb8436a/users/6b8c4242239d4ec1b821f26b335f7cdb/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:25:57.159375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b117f86-85ba-4581-97b7-601083e98433 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:57.159754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b117f86-85ba-4581-97b7-601083e98433 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:57.160104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b117f86-85ba-4581-97b7-601083e98433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:57.195971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4b117f86-85ba-4581-97b7-601083e98433 None None] MFA Rules not processed for user `6b8c4242239d4ec1b821f26b335f7cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:25:57.197787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4b117f86-85ba-4581-97b7-601083e98433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:57.290020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 960/1906] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:25:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:25:57.302674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1336-ffbb-4ab8-aaf8-f5cbd7fcca24 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:25:57.304867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-cb4b1336-ffbb-4ab8-aaf8-f5cbd7fcca24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:25:57.372065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1336-ffbb-4ab8-aaf8-f5cbd7fcca24 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:25:57.375986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08f409-3c49-4272-940f-3c8300b94ed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:25:57.376648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08f409-3c49-4272-940f-3c8300b94ed2 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:25:57.376926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08f409-3c49-4272-940f-3c8300b94ed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:25:57.377201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08f409-3c49-4272-940f-3c8300b94ed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:25:57.386836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08f409-3c49-4272-940f-3c8300b94ed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:25:57.388289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08f409-3c49-4272-940f-3c8300b94ed2 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:25:57.399132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 947/1907] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:25:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:02.384274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b117f86-85ba-4581-97b7-601083e98433 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:02.387128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4b117f86-85ba-4581-97b7-601083e98433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:02.557067 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b117f86-85ba-4581-97b7-601083e98433 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:02.568245 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:02.569668 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:02.570148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:02.570640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] PATH_INFO: `/v3/users/6c613d12df3040e789f051385ca1f5b7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:02.573036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c613d12df3040e789f051385ca1f5b7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:02.576860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:02.676440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c613d12df3040e789f051385ca1f5b7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:02.687275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c613d12df3040e789f051385ca1f5b7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:02.688493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c613d12df3040e789f051385ca1f5b7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:02.702090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c613d12df3040e789f051385ca1f5b7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:02.726974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c613d12df3040e789f051385ca1f5b7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:02.739981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 961/1908] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:02 2022] DELETE /identity/v3/users/6c613d12df3040e789f051385ca1f5b7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:02.748070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a7b03-d595-4128-bc3e-c597acf2509c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:02.748950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a7b03-d595-4128-bc3e-c597acf2509c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:02.749096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a7b03-d595-4128-bc3e-c597acf2509c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:02.777220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-145a7b03-d595-4128-bc3e-c597acf2509c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:02.779808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-145a7b03-d595-4128-bc3e-c597acf2509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:02.940244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 948/1909] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:02.967413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:02.969811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:03.100263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c95188-7fe3-4268-8806-c9cf277aa392 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:03.113827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a7b03-d595-4128-bc3e-c597acf2509c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:03.116858 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-145a7b03-d595-4128-bc3e-c597acf2509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:03.118241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6c552-a861-4bab-8139-3ecf09b02108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:03.122688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c552-a861-4bab-8139-3ecf09b02108 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:03.123238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c552-a861-4bab-8139-3ecf09b02108 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:03.123747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6c552-a861-4bab-8139-3ecf09b02108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:03.146774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a7b03-d595-4128-bc3e-c597acf2509c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:03.156849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:03.159101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:03.159927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:03.160645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] PATH_INFO: `/v3/users/6b8c4242239d4ec1b821f26b335f7cdb` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:03.162913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6c552-a861-4bab-8139-3ecf09b02108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:03.164120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8c4242239d4ec1b821f26b335f7cdb)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:03.165928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6c552-a861-4bab-8139-3ecf09b02108 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:03.168820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:03.198099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 962/1910] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:26:03.340870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8c4242239d4ec1b821f26b335f7cdb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:03.363932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8c4242239d4ec1b821f26b335f7cdb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:03.395489 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8c4242239d4ec1b821f26b335f7cdb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:03.398357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8c4242239d4ec1b821f26b335f7cdb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:03.443537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8c4242239d4ec1b821f26b335f7cdb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:03.479193 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 949/1911] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:03 2022] DELETE /identity/v3/users/6b8c4242239d4ec1b821f26b335f7cdb => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:03.486880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398283-a927-406a-8e7d-03b3cbc5aa79 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:03.488446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398283-a927-406a-8e7d-03b3cbc5aa79 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:03.489123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf398283-a927-406a-8e7d-03b3cbc5aa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:03.525613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-bf398283-a927-406a-8e7d-03b3cbc5aa79 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:03.528160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-bf398283-a927-406a-8e7d-03b3cbc5aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:03.702552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 963/1912] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:03.770822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:03.773904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:03.905939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf398283-a927-406a-8e7d-03b3cbc5aa79 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:03.905939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-bf398283-a927-406a-8e7d-03b3cbc5aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:03.965450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf398283-a927-406a-8e7d-03b3cbc5aa79 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:03.983382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:03.985046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:03.985046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:03.986522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] PATH_INFO: `/v3/projects/1a76c50170904c9998132d76e08cc94d` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:03.989873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a76c50170904c9998132d76e08cc94d)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:03.993123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:04.039446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc403b26-98ba-41ba-9b67-ae519b6093cb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:04.043751 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a0319-07fd-4c72-85e2-3f72dd8d3b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:04.044569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a0319-07fd-4c72-85e2-3f72dd8d3b21 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:04.045018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a0319-07fd-4c72-85e2-3f72dd8d3b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:04.045493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a0319-07fd-4c72-85e2-3f72dd8d3b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:04.060146 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a0319-07fd-4c72-85e2-3f72dd8d3b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:04.063112 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a0319-07fd-4c72-85e2-3f72dd8d3b21 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:04.086206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 950/1913] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:04.091794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a76c50170904c9998132d76e08cc94d', 'request_id': 'req-03958310-9610-4662-8461-5da6f55de537'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:04.100080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a76c50170904c9998132d76e08cc94d', 'request_id': 'req-03958310-9610-4662-8461-5da6f55de537'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:04.110766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a76c50170904c9998132d76e08cc94d', 'request_id': 'req-03958310-9610-4662-8461-5da6f55de537'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:04.131947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] The token cache is being invalidate because project 1a76c50170904c9998132d76e08cc94d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:04.132436 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:04.133504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:04.137302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 964/1914] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:03 2022] DELETE /identity/v3/projects/1a76c50170904c9998132d76e08cc94d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:04.142605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a0319-07fd-4c72-85e2-3f72dd8d3b21 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:04.160318 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a0319-07fd-4c72-85e2-3f72dd8d3b21 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:04.293389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:04.296430 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:04.297374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:04.299396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] PATH_INFO: `/v3/users/151aefbb2d384a62bc291e4e77cdc283` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:04.301647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=151aefbb2d384a62bc291e4e77cdc283)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:04.306780 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:04.416106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151aefbb2d384a62bc291e4e77cdc283'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:04.428219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151aefbb2d384a62bc291e4e77cdc283'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:04.463205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151aefbb2d384a62bc291e4e77cdc283'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:04.464691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151aefbb2d384a62bc291e4e77cdc283'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:04.478714 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-5a00abac-02f1-43d3-aa03-35cb8c366adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151aefbb2d384a62bc291e4e77cdc283'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:04.493773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 951/1915] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:04 2022] DELETE /identity/v3/users/151aefbb2d384a62bc291e4e77cdc283 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:05.040442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:05.043921 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:05.118235 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958310-9610-4662-8461-5da6f55de537 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:05.310234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:05.311667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:05.312147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:05.312564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] PATH_INFO: `/v3/projects/1db385c40538494bb9a940d2382575ed` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:05.314882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db385c40538494bb9a940d2382575ed)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:05.318824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:05.431705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db385c40538494bb9a940d2382575ed', 'request_id': 'req-0f6506c5-1745-4a0f-81a0-2706971a1c61'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:05.442976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db385c40538494bb9a940d2382575ed', 'request_id': 'req-0f6506c5-1745-4a0f-81a0-2706971a1c61'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:05.458825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db385c40538494bb9a940d2382575ed', 'request_id': 'req-0f6506c5-1745-4a0f-81a0-2706971a1c61'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:05.476952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] The token cache is being invalidate because project 1db385c40538494bb9a940d2382575ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:05.477688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:05.479363 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0f6506c5-1745-4a0f-81a0-2706971a1c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:05.481344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 965/1916] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:05 2022] DELETE /identity/v3/projects/1db385c40538494bb9a940d2382575ed => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:05.491079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88847ccb-7673-4353-88b6-e71e414c8de1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:05.492426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88847ccb-7673-4353-88b6-e71e414c8de1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:05.493019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88847ccb-7673-4353-88b6-e71e414c8de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:05.534638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-88847ccb-7673-4353-88b6-e71e414c8de1 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:05.537941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-88847ccb-7673-4353-88b6-e71e414c8de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:05.648337 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 952/1917] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:05.660856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840886a-850f-4c3b-864c-9b696f399283 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:05.661509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840886a-850f-4c3b-864c-9b696f399283 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:05.661844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840886a-850f-4c3b-864c-9b696f399283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:05.696440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4840886a-850f-4c3b-864c-9b696f399283 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:05.698710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4840886a-850f-4c3b-864c-9b696f399283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:05.717289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 966/1918] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:05.722370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88847ccb-7673-4353-88b6-e71e414c8de1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:05.739523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88847ccb-7673-4353-88b6-e71e414c8de1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:05.747097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcd085-9942-407c-a112-02d36ce8bdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:05.747989 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd085-9942-407c-a112-02d36ce8bdab admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:05.748274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd085-9942-407c-a112-02d36ce8bdab admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:05.748552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd085-9942-407c-a112-02d36ce8bdab admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:05.749370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcd085-9942-407c-a112-02d36ce8bdab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:05.753178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcd085-9942-407c-a112-02d36ce8bdab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:05.755578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcd085-9942-407c-a112-02d36ce8bdab admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:05.756168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840886a-850f-4c3b-864c-9b696f399283 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:05.760655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4840886a-850f-4c3b-864c-9b696f399283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:05.770881 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 953/1919] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:05.775953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcd085-9942-407c-a112-02d36ce8bdab admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:05.787293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcd085-9942-407c-a112-02d36ce8bdab admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:05.803694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead4f69-e790-4b28-a152-748d5beaddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:05.804443 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead4f69-e790-4b28-a152-748d5beaddc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:05.804727 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead4f69-e790-4b28-a152-748d5beaddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:05.805025 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead4f69-e790-4b28-a152-748d5beaddc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:05.806492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead4f69-e790-4b28-a152-748d5beaddc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:05.808646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead4f69-e790-4b28-a152-748d5beaddc0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:05.868931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840886a-850f-4c3b-864c-9b696f399283 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:05.888845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:05.890566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:05.891210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:05.891889 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] PATH_INFO: `/v3/projects/ee2efde1a5584fd7bb7f97ba1cb8436a` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:05.896696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2efde1a5584fd7bb7f97ba1cb8436a)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:05.897354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 954/1920] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:05 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:05.900241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead4f69-e790-4b28-a152-748d5beaddc0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:05.903271 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:05.994533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead4f69-e790-4b28-a152-748d5beaddc0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:06.008968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892885b8-4439-4aa2-81fc-5b4735c63615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:06.013547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892885b8-4439-4aa2-81fc-5b4735c63615 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:06.014082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892885b8-4439-4aa2-81fc-5b4735c63615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:06.014538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892885b8-4439-4aa2-81fc-5b4735c63615 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:06.019259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892885b8-4439-4aa2-81fc-5b4735c63615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:06.029723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892885b8-4439-4aa2-81fc-5b4735c63615 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:06.091591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 955/1921] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:05 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:06.093462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892885b8-4439-4aa2-81fc-5b4735c63615 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:06.119744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892885b8-4439-4aa2-81fc-5b4735c63615 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:06.123892 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2efde1a5584fd7bb7f97ba1cb8436a', 'request_id': 'req-9e714a4c-93dc-4b26-aeab-a2aff81c903b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:06.138026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2efde1a5584fd7bb7f97ba1cb8436a', 'request_id': 'req-9e714a4c-93dc-4b26-aeab-a2aff81c903b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:06.148025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2efde1a5584fd7bb7f97ba1cb8436a', 'request_id': 'req-9e714a4c-93dc-4b26-aeab-a2aff81c903b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:06.177802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] The token cache is being invalidate because project ee2efde1a5584fd7bb7f97ba1cb8436a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:06.178142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:06.182653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9e714a4c-93dc-4b26-aeab-a2aff81c903b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:06.188472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 967/1922] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:05 2022] DELETE /identity/v3/projects/ee2efde1a5584fd7bb7f97ba1cb8436a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:06.202614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc36fa-2ecf-4248-9d11-c63ee7b23f00 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:06.203366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc36fa-2ecf-4248-9d11-c63ee7b23f00 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:06.203992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc36fa-2ecf-4248-9d11-c63ee7b23f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:06.250342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-03cc36fa-2ecf-4248-9d11-c63ee7b23f00 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:06.252695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-03cc36fa-2ecf-4248-9d11-c63ee7b23f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:06.279924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6bb1b-ab06-4864-8815-77c78081f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:06.280899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6bb1b-ab06-4864-8815-77c78081f180 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:06.281403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6bb1b-ab06-4864-8815-77c78081f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:06.281905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6bb1b-ab06-4864-8815-77c78081f180 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:06.282989 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6bb1b-ab06-4864-8815-77c78081f180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:06.286160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6bb1b-ab06-4864-8815-77c78081f180 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:06.314986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 956/1923] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:06.316353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6bb1b-ab06-4864-8815-77c78081f180 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:06.321705 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-eca6bb1b-ab06-4864-8815-77c78081f180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:06.358109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6bb1b-ab06-4864-8815-77c78081f180 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:06.371414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdea75-9f00-4b67-b39c-4c356e38b779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:06.371414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdea75-9f00-4b67-b39c-4c356e38b779 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:06.371414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdea75-9f00-4b67-b39c-4c356e38b779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:06.372019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdea75-9f00-4b67-b39c-4c356e38b779 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:06.373733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdea75-9f00-4b67-b39c-4c356e38b779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:06.377460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdea75-9f00-4b67-b39c-4c356e38b779 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:06.414664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 957/1924] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:06.419334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 968/1925] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:06.425911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdea75-9f00-4b67-b39c-4c356e38b779 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:06.432892 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ea080-b39b-4007-bd7c-8ab6d99c545e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:06.433570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ea080-b39b-4007-bd7c-8ab6d99c545e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:06.433857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ea080-b39b-4007-bd7c-8ab6d99c545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:06.447497 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdea75-9f00-4b67-b39c-4c356e38b779 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:06.460138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-2c4ea080-b39b-4007-bd7c-8ab6d99c545e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:06.460419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc60da-0651-475c-8730-119b23b78c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:06.462549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc60da-0651-475c-8730-119b23b78c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:06.462754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-2c4ea080-b39b-4007-bd7c-8ab6d99c545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:06.462910 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc60da-0651-475c-8730-119b23b78c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:06.463275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc60da-0651-475c-8730-119b23b78c6e admin admin] PATH_INFO: `/v3/projects/008a2499546e4737a380201791f5216c/users/502b6a2a60ad4514856d4e70a9dadc92/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:06.475781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 969/1926] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:06.482590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ea080-b39b-4007-bd7c-8ab6d99c545e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:06.493600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc60da-0651-475c-8730-119b23b78c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=008a2499546e4737a380201791f5216c, user_id=502b6a2a60ad4514856d4e70a9dadc92, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:06.499401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc60da-0651-475c-8730-119b23b78c6e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:06.499737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ea080-b39b-4007-bd7c-8ab6d99c545e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:06.507801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608804-9a32-446e-b584-db03b6c001ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:06.509091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608804-9a32-446e-b584-db03b6c001ab admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:06.509749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608804-9a32-446e-b584-db03b6c001ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:06.510260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608804-9a32-446e-b584-db03b6c001ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:06.511616 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608804-9a32-446e-b584-db03b6c001ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:06.512249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608804-9a32-446e-b584-db03b6c001ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:06.515472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608804-9a32-446e-b584-db03b6c001ab admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:06.524884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 958/1927] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:06 2022] PUT /identity/v3/projects/008a2499546e4737a380201791f5216c/users/502b6a2a60ad4514856d4e70a9dadc92/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:06.545380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938a73-023c-433e-8b06-27e71f0f5591 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:06.545380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938a73-023c-433e-8b06-27e71f0f5591 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:06.545784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45938a73-023c-433e-8b06-27e71f0f5591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:06.560631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 970/1928] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:26:06.560631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608804-9a32-446e-b584-db03b6c001ab admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:06.578565 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608804-9a32-446e-b584-db03b6c001ab admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:06.611719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-45938a73-023c-433e-8b06-27e71f0f5591 None None] MFA Rules not processed for user `502b6a2a60ad4514856d4e70a9dadc92`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:06.613923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-45938a73-023c-433e-8b06-27e71f0f5591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:06.747520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd6db-4aba-43ac-825b-a72c666423e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:06.762371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd6db-4aba-43ac-825b-a72c666423e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:06.762964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd6db-4aba-43ac-825b-a72c666423e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:06.763506 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd6db-4aba-43ac-825b-a72c666423e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:06.764898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebd6db-4aba-43ac-825b-a72c666423e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:06.781805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebd6db-4aba-43ac-825b-a72c666423e7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:06.817830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 959/1929] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:06.824383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45938a73-023c-433e-8b06-27e71f0f5591 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:06.846749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45938a73-023c-433e-8b06-27e71f0f5591 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:06.853411 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e9f1f-7703-4e11-a7d2-094543b82f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:06.854358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e9f1f-7703-4e11-a7d2-094543b82f0a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:06.854906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e9f1f-7703-4e11-a7d2-094543b82f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:06.855477 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e9f1f-7703-4e11-a7d2-094543b82f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:06.856634 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e9f1f-7703-4e11-a7d2-094543b82f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:06.860966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e9f1f-7703-4e11-a7d2-094543b82f0a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:06.879504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 971/1930] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:06 2022] POST /identity/v3/projects => generated 367 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:06.884640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd6db-4aba-43ac-825b-a72c666423e7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:06.932796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 960/1931] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:06 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:06.940596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e9f1f-7703-4e11-a7d2-094543b82f0a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:07.029329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd6db-4aba-43ac-825b-a72c666423e7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:07.152842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81528b88-49cf-49a5-a81e-0c3cd17b2ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:07.155335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528b88-49cf-49a5-a81e-0c3cd17b2ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.155558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e9f1f-7703-4e11-a7d2-094543b82f0a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:07.156350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528b88-49cf-49a5-a81e-0c3cd17b2ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.157107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528b88-49cf-49a5-a81e-0c3cd17b2ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.158804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81528b88-49cf-49a5-a81e-0c3cd17b2ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:07.163325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81528b88-49cf-49a5-a81e-0c3cd17b2ea3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:07.167090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a13158-a950-41d3-88b0-907739694a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:07.169020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a13158-a950-41d3-88b0-907739694a9f admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.169732 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a13158-a950-41d3-88b0-907739694a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.170030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a13158-a950-41d3-88b0-907739694a9f admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.170806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a13158-a950-41d3-88b0-907739694a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:07.174404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a13158-a950-41d3-88b0-907739694a9f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:07.203253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 972/1932] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:06 2022] POST /identity/v3/users => generated 284 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:07.209722 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81528b88-49cf-49a5-a81e-0c3cd17b2ea3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:07.217593 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 961/1933] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:06 2022] POST /identity/v3/users => generated 294 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:07.222424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a13158-a950-41d3-88b0-907739694a9f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:07.229561 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81528b88-49cf-49a5-a81e-0c3cd17b2ea3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:07.239350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012f956-c8ad-46fb-9df9-c45f5cd0b9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:07.240807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012f956-c8ad-46fb-9df9-c45f5cd0b9cd admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.241622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012f956-c8ad-46fb-9df9-c45f5cd0b9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.242311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012f956-c8ad-46fb-9df9-c45f5cd0b9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.243512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012f956-c8ad-46fb-9df9-c45f5cd0b9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:07.247333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012f956-c8ad-46fb-9df9-c45f5cd0b9cd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:07.248913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a13158-a950-41d3-88b0-907739694a9f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:07.258323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b37cf8-fafe-459c-8f8c-26869a2f4fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:07.259830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b37cf8-fafe-459c-8f8c-26869a2f4fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.260364 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b37cf8-fafe-459c-8f8c-26869a2f4fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.260882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b37cf8-fafe-459c-8f8c-26869a2f4fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.263265 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b37cf8-fafe-459c-8f8c-26869a2f4fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:07.267062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b37cf8-fafe-459c-8f8c-26869a2f4fa9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:07.270537 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 973/1934] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:07.279491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012f956-c8ad-46fb-9df9-c45f5cd0b9cd admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:07.292070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 962/1935] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:07.299054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b37cf8-fafe-459c-8f8c-26869a2f4fa9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:07.306147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012f956-c8ad-46fb-9df9-c45f5cd0b9cd admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:07.321006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004082d7-2c97-47b8-9612-4717cfa06fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:07.322270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004082d7-2c97-47b8-9612-4717cfa06fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.324495 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004082d7-2c97-47b8-9612-4717cfa06fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.325820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004082d7-2c97-47b8-9612-4717cfa06fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.327774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004082d7-2c97-47b8-9612-4717cfa06fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:07.331677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004082d7-2c97-47b8-9612-4717cfa06fd0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:07.341567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b37cf8-fafe-459c-8f8c-26869a2f4fa9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:07.361836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bad4fe-80f0-47da-945e-d48682338a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:07.363424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bad4fe-80f0-47da-945e-d48682338a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.364150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bad4fe-80f0-47da-945e-d48682338a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.364826 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bad4fe-80f0-47da-945e-d48682338a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.366467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bad4fe-80f0-47da-945e-d48682338a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:07.371507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 974/1936] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:07.381448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004082d7-2c97-47b8-9612-4717cfa06fd0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:07.385486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bad4fe-80f0-47da-945e-d48682338a68 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:07.402648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004082d7-2c97-47b8-9612-4717cfa06fd0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:07.408887 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df6538-d32a-4d3c-9bd2-0956e0f1e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:07.410883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6538-d32a-4d3c-9bd2-0956e0f1e1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.411558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6538-d32a-4d3c-9bd2-0956e0f1e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.412593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df6538-d32a-4d3c-9bd2-0956e0f1e1cc admin admin] PATH_INFO: `/v3/projects/375c328adffb4a249713cab314942fb6/users/d471c27249934edc98ca22f4c49ff99e/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.426134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 963/1937] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:07.430537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bad4fe-80f0-47da-945e-d48682338a68 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:07.451627 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bad4fe-80f0-47da-945e-d48682338a68 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:07.474578 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df6538-d32a-4d3c-9bd2-0956e0f1e1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=375c328adffb4a249713cab314942fb6, user_id=d471c27249934edc98ca22f4c49ff99e, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:07.476165 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c4e3a-45f6-49bc-a3f5-f1da006d4567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:07.477332 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df6538-d32a-4d3c-9bd2-0956e0f1e1cc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:07.477651 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c4e3a-45f6-49bc-a3f5-f1da006d4567 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.478065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c4e3a-45f6-49bc-a3f5-f1da006d4567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.478513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c4e3a-45f6-49bc-a3f5-f1da006d4567 admin admin] PATH_INFO: `/v3/projects/83a7176ecb0646b3a74e87a9c40b91e9/users/3aaf8f46d0604dd9af58cdf4792d06ef/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.496572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 975/1938] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:07 2022] PUT /identity/v3/projects/375c328adffb4a249713cab314942fb6/users/d471c27249934edc98ca22f4c49ff99e/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:07.514283 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebfe14-5f52-4a16-a919-ca1482f10a4d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.517899 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebfe14-5f52-4a16-a919-ca1482f10a4d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.518623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebfe14-5f52-4a16-a919-ca1482f10a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.523707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c4e3a-45f6-49bc-a3f5-f1da006d4567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a7176ecb0646b3a74e87a9c40b91e9, user_id=3aaf8f46d0604dd9af58cdf4792d06ef, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:07.532972 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c4e3a-45f6-49bc-a3f5-f1da006d4567 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:07.561983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 964/1939] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:07 2022] PUT /identity/v3/projects/83a7176ecb0646b3a74e87a9c40b91e9/users/3aaf8f46d0604dd9af58cdf4792d06ef/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:07.577697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e2ebfe14-5f52-4a16-a919-ca1482f10a4d None None] MFA Rules not processed for user `d471c27249934edc98ca22f4c49ff99e`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:07.579250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e2ebfe14-5f52-4a16-a919-ca1482f10a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:07.583705 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ec28-9e58-4ed7-84ea-34f62a9bdf8c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.584615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ec28-9e58-4ed7-84ea-34f62a9bdf8c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.588018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ec28-9e58-4ed7-84ea-34f62a9bdf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.645566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d1e6ec28-9e58-4ed7-84ea-34f62a9bdf8c None None] MFA Rules not processed for user `3aaf8f46d0604dd9af58cdf4792d06ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:07.647988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d1e6ec28-9e58-4ed7-84ea-34f62a9bdf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:07.691500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 976/1940] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:07.712024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebfe14-5f52-4a16-a919-ca1482f10a4d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:07.714603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e2ebfe14-5f52-4a16-a919-ca1482f10a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:07.792407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 965/1941] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:07.799125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ec28-9e58-4ed7-84ea-34f62a9bdf8c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:07.876988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebfe14-5f52-4a16-a919-ca1482f10a4d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:07.883991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db65da1-c390-4f3e-82af-06a68fb7e196 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec2950259d4ed0925d7a19a6217af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:07.885132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db65da1-c390-4f3e-82af-06a68fb7e196 service glance] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.885781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db65da1-c390-4f3e-82af-06a68fb7e196 service glance] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.886276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db65da1-c390-4f3e-82af-06a68fb7e196 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.913940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db65da1-c390-4f3e-82af-06a68fb7e196 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:07.915826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db65da1-c390-4f3e-82af-06a68fb7e196 service glance] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:07.930858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 977/1942] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:26:07.943547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ec28-9e58-4ed7-84ea-34f62a9bdf8c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:07.950356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad168e7-0c23-4ce4-8b1a-e189ea4f8c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:07.951332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad168e7-0c23-4ce4-8b1a-e189ea4f8c5a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:07.951526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad168e7-0c23-4ce4-8b1a-e189ea4f8c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:07.951836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad168e7-0c23-4ce4-8b1a-e189ea4f8c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:07.952648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad168e7-0c23-4ce4-8b1a-e189ea4f8c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:07.955401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad168e7-0c23-4ce4-8b1a-e189ea4f8c5a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:08.009105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 966/1943] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:07 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:08.014571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db65da1-c390-4f3e-82af-06a68fb7e196 service glance] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:08.034765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db65da1-c390-4f3e-82af-06a68fb7e196 service glance] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:08.144777 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61b0f0-c587-4c16-b5b8-d5feae0e2c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:08.146080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61b0f0-c587-4c16-b5b8-d5feae0e2c8e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:08.146699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61b0f0-c587-4c16-b5b8-d5feae0e2c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:08.147312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61b0f0-c587-4c16-b5b8-d5feae0e2c8e admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:08.148788 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61b0f0-c587-4c16-b5b8-d5feae0e2c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:08.156102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61b0f0-c587-4c16-b5b8-d5feae0e2c8e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:08.207589 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad168e7-0c23-4ce4-8b1a-e189ea4f8c5a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:08.210390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 978/1944] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:08 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:08.226241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad168e7-0c23-4ce4-8b1a-e189ea4f8c5a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:08.258428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87fcf2-0f6c-4e05-9490-9ac4f224dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:08.263911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87fcf2-0f6c-4e05-9490-9ac4f224dff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:08.264435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87fcf2-0f6c-4e05-9490-9ac4f224dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:08.264916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87fcf2-0f6c-4e05-9490-9ac4f224dff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:08.268845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87fcf2-0f6c-4e05-9490-9ac4f224dff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:08.275433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87fcf2-0f6c-4e05-9490-9ac4f224dff0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:08.343966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 967/1945] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:08.346196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61b0f0-c587-4c16-b5b8-d5feae0e2c8e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:08.376346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61b0f0-c587-4c16-b5b8-d5feae0e2c8e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:08.396395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf54967-6ece-4e49-b5b2-79ec988e614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:08.397216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf54967-6ece-4e49-b5b2-79ec988e614d admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:08.397534 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf54967-6ece-4e49-b5b2-79ec988e614d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:08.397845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf54967-6ece-4e49-b5b2-79ec988e614d admin admin] PATH_INFO: `/v3/projects/622d4c79a3da4f80ac68d090938f6f48/users/073cb489f01940989232f54f5258398c/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:08.434239 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf54967-6ece-4e49-b5b2-79ec988e614d admin admin] RBAC: Authorizing `identity:create_grant(project_id=622d4c79a3da4f80ac68d090938f6f48, user_id=073cb489f01940989232f54f5258398c, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:08.437008 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf54967-6ece-4e49-b5b2-79ec988e614d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:08.481597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 979/1946] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:08 2022] PUT /identity/v3/projects/622d4c79a3da4f80ac68d090938f6f48/users/073cb489f01940989232f54f5258398c/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:08.487892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87fcf2-0f6c-4e05-9490-9ac4f224dff0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:08.518040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87fcf2-0f6c-4e05-9490-9ac4f224dff0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:08.622810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f201de-a90a-405b-b2b2-463b7abe2223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:08.625259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f201de-a90a-405b-b2b2-463b7abe2223 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:08.625259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f201de-a90a-405b-b2b2-463b7abe2223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:08.625259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f201de-a90a-405b-b2b2-463b7abe2223 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:08.627198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f201de-a90a-405b-b2b2-463b7abe2223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:08.631517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f201de-a90a-405b-b2b2-463b7abe2223 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:08.656964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 968/1947] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:08.664492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf54967-6ece-4e49-b5b2-79ec988e614d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:08.705572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf54967-6ece-4e49-b5b2-79ec988e614d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:08.711875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9ab5-15e4-4062-80ae-27143633a793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:08.711875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9ab5-15e4-4062-80ae-27143633a793 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:08.711875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9ab5-15e4-4062-80ae-27143633a793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:08.712716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c9ab5-15e4-4062-80ae-27143633a793 admin admin] PATH_INFO: `/v3/projects/622d4c79a3da4f80ac68d090938f6f48/users/073cb489f01940989232f54f5258398c/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:08.727361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c9ab5-15e4-4062-80ae-27143633a793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622d4c79a3da4f80ac68d090938f6f48, user_id=073cb489f01940989232f54f5258398c, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:08.737699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c9ab5-15e4-4062-80ae-27143633a793 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:08.789473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 980/1948] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:08 2022] PUT /identity/v3/projects/622d4c79a3da4f80ac68d090938f6f48/users/073cb489f01940989232f54f5258398c/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:08.813066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df34bd-e5fa-4187-9242-7cb0b84eb171 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:08.813749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df34bd-e5fa-4187-9242-7cb0b84eb171 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:08.814288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df34bd-e5fa-4187-9242-7cb0b84eb171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:08.875758 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b7df34bd-e5fa-4187-9242-7cb0b84eb171 None None] MFA Rules not processed for user `073cb489f01940989232f54f5258398c`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:08.878190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b7df34bd-e5fa-4187-9242-7cb0b84eb171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:09.049640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 969/1949] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:09.070202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9ab5-15e4-4062-80ae-27143633a793 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:09.072749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a83c9ab5-15e4-4062-80ae-27143633a793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:09.185257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c9ab5-15e4-4062-80ae-27143633a793 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:09.191922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3b88a-cf20-48c7-b6ca-8129ebd8419f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:09.193054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3b88a-cf20-48c7-b6ca-8129ebd8419f service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:09.193588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3b88a-cf20-48c7-b6ca-8129ebd8419f service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:09.194097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3b88a-cf20-48c7-b6ca-8129ebd8419f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:09.209791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3b88a-cf20-48c7-b6ca-8129ebd8419f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:09.212423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3b88a-cf20-48c7-b6ca-8129ebd8419f service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:09.228801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 981/1950] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:10.199065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df34bd-e5fa-4187-9242-7cb0b84eb171 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:10.216419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df34bd-e5fa-4187-9242-7cb0b84eb171 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:10.222024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228754a-c792-4084-b0cc-f3669fce2661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:10.223088 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228754a-c792-4084-b0cc-f3669fce2661 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:10.223559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228754a-c792-4084-b0cc-f3669fce2661 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:10.224004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228754a-c792-4084-b0cc-f3669fce2661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:10.320064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228754a-c792-4084-b0cc-f3669fce2661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:10.322679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228754a-c792-4084-b0cc-f3669fce2661 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:10.332617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 970/1951] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:26:17.025224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3b88a-cf20-48c7-b6ca-8129ebd8419f service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:17.039875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3b88a-cf20-48c7-b6ca-8129ebd8419f service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:17.048151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ba392-8290-47f8-83c6-e4b93a20a3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:17.049617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ba392-8290-47f8-83c6-e4b93a20a3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:17.050078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ba392-8290-47f8-83c6-e4b93a20a3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:17.050536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ba392-8290-47f8-83c6-e4b93a20a3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:17.126770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ba392-8290-47f8-83c6-e4b93a20a3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:17.128134 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ba392-8290-47f8-83c6-e4b93a20a3b0 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:17.138137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 982/1952] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:18.147884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274cc3c-be14-4ed0-a8ad-13df75418a65 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:18.149782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274cc3c-be14-4ed0-a8ad-13df75418a65 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:18.150535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274cc3c-be14-4ed0-a8ad-13df75418a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:18.176523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d274cc3c-be14-4ed0-a8ad-13df75418a65 None None] MFA Rules not processed for user `bdd86efb97ad48a994f04304a8459e54`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:18.177820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d274cc3c-be14-4ed0-a8ad-13df75418a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:18.266821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 971/1953] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:18.684820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ba392-8290-47f8-83c6-e4b93a20a3b0 service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:18.687115 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-cd2ba392-8290-47f8-83c6-e4b93a20a3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:18.782610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ba392-8290-47f8-83c6-e4b93a20a3b0 service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:18.788383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:18.789484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:18.789826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:18.790222 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] PATH_INFO: `/v3/users/04bd619a0423408c8f0aab9dbe2df347` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:18.791614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04bd619a0423408c8f0aab9dbe2df347)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:18.793828 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:18.859529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04bd619a0423408c8f0aab9dbe2df347'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:18.870187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04bd619a0423408c8f0aab9dbe2df347'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:18.871845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04bd619a0423408c8f0aab9dbe2df347'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:18.884231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04bd619a0423408c8f0aab9dbe2df347'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:18.904309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04bd619a0423408c8f0aab9dbe2df347'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:18.914569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 983/1954] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:18 2022] DELETE /identity/v3/users/04bd619a0423408c8f0aab9dbe2df347 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:18.922074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8563-8d0b-4408-aba9-6d9603f47231 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:18.922711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8563-8d0b-4408-aba9-6d9603f47231 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:18.923288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8563-8d0b-4408-aba9-6d9603f47231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:18.950832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-627a8563-8d0b-4408-aba9-6d9603f47231 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:18.953069 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-627a8563-8d0b-4408-aba9-6d9603f47231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:19.063671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 972/1955] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:19.087076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:19.089361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:19.238837 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c464393-77a8-449d-97f6-47a97827439f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:19.256707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256ccf4-0fd8-47c4-9b39-730b91f95d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:19.257713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256ccf4-0fd8-47c4-9b39-730b91f95d36 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:19.258207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256ccf4-0fd8-47c4-9b39-730b91f95d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:19.258509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256ccf4-0fd8-47c4-9b39-730b91f95d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:19.287119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256ccf4-0fd8-47c4-9b39-730b91f95d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:19.291269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256ccf4-0fd8-47c4-9b39-730b91f95d36 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:19.307975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 984/1956] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:26:19.687739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8563-8d0b-4408-aba9-6d9603f47231 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:19.690204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-627a8563-8d0b-4408-aba9-6d9603f47231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:19.714209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8563-8d0b-4408-aba9-6d9603f47231 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:19.720739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:19.722242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:19.722699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:19.723116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] PATH_INFO: `/v3/projects/f0b0ad8e7afc4658921e59c94a9c6d2b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:19.724588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b0ad8e7afc4658921e59c94a9c6d2b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:19.726774 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:19.855577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b0ad8e7afc4658921e59c94a9c6d2b', 'request_id': 'req-dfd469f4-f5c5-440c-8b74-1451d03a88ec'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:19.872100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b0ad8e7afc4658921e59c94a9c6d2b', 'request_id': 'req-dfd469f4-f5c5-440c-8b74-1451d03a88ec'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:19.886935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b0ad8e7afc4658921e59c94a9c6d2b', 'request_id': 'req-dfd469f4-f5c5-440c-8b74-1451d03a88ec'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:19.912870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] The token cache is being invalidate because project f0b0ad8e7afc4658921e59c94a9c6d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:19.913166 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:19.914273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:19.919791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 973/1957] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:19 2022] DELETE /identity/v3/projects/f0b0ad8e7afc4658921e59c94a9c6d2b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:19.924381 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256ccf4-0fd8-47c4-9b39-730b91f95d36 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:19.943975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256ccf4-0fd8-47c4-9b39-730b91f95d36 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:20.051641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:20.052543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:20.052844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:20.053185 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] PATH_INFO: `/v3/users/9618a3116ccd47f7952b7dc2aafb74dc` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:20.054803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9618a3116ccd47f7952b7dc2aafb74dc)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:20.056563 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:20.165569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9618a3116ccd47f7952b7dc2aafb74dc'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.174778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9618a3116ccd47f7952b7dc2aafb74dc'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.176227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9618a3116ccd47f7952b7dc2aafb74dc'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.195829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9618a3116ccd47f7952b7dc2aafb74dc'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.212985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e72b2090-974a-4ce7-a020-2a71e7fe05d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9618a3116ccd47f7952b7dc2aafb74dc'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.220256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:20.223082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:20.228228 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 985/1958] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:19 2022] DELETE /identity/v3/users/9618a3116ccd47f7952b7dc2aafb74dc => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:20.241592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd469f4-f5c5-440c-8b74-1451d03a88ec admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:20.323254 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:20.325740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:20.326465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:20.327321 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] PATH_INFO: `/v3/users/502b6a2a60ad4514856d4e70a9dadc92` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:20.330567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=502b6a2a60ad4514856d4e70a9dadc92)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:20.337845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:20.449166 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502b6a2a60ad4514856d4e70a9dadc92'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.461849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502b6a2a60ad4514856d4e70a9dadc92'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.478514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502b6a2a60ad4514856d4e70a9dadc92'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.481910 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502b6a2a60ad4514856d4e70a9dadc92'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.492781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502b6a2a60ad4514856d4e70a9dadc92'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.502968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 974/1959] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:20 2022] DELETE /identity/v3/users/502b6a2a60ad4514856d4e70a9dadc92 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:20.510297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2ada8-3a56-44d1-b46e-b21f88c86b9a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:20.510964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2ada8-3a56-44d1-b46e-b21f88c86b9a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:20.511259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2ada8-3a56-44d1-b46e-b21f88c86b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:20.547979 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-39c2ada8-3a56-44d1-b46e-b21f88c86b9a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:20.553820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-39c2ada8-3a56-44d1-b46e-b21f88c86b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:20.630914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 986/1960] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:20.647541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:20.649464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:20.725659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea8e5c-1c52-4e7d-a3c7-b94ba6102156 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:20.730752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dc6c2-6130-400c-93d5-fdd925f718c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:20.731699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc6c2-6130-400c-93d5-fdd925f718c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:20.732163 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc6c2-6130-400c-93d5-fdd925f718c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:20.732735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dc6c2-6130-400c-93d5-fdd925f718c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:20.745142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dc6c2-6130-400c-93d5-fdd925f718c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:20.747336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8dc6c2-6130-400c-93d5-fdd925f718c5 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:20.748767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2ada8-3a56-44d1-b46e-b21f88c86b9a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:20.753168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-39c2ada8-3a56-44d1-b46e-b21f88c86b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:20.761439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 975/1961] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:20.780333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2ada8-3a56-44d1-b46e-b21f88c86b9a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:20.786305 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:20.787782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:20.788274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:20.788736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] PATH_INFO: `/v3/projects/36537646071d4cd3b4309820b34920d4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:20.798218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36537646071d4cd3b4309820b34920d4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:20.800886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:20.881337 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36537646071d4cd3b4309820b34920d4', 'request_id': 'req-a77c4991-0d60-4a70-8180-b1d4635d0a05'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.893978 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36537646071d4cd3b4309820b34920d4', 'request_id': 'req-a77c4991-0d60-4a70-8180-b1d4635d0a05'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.912719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36537646071d4cd3b4309820b34920d4', 'request_id': 'req-a77c4991-0d60-4a70-8180-b1d4635d0a05'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.946326 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] The token cache is being invalidate because project 36537646071d4cd3b4309820b34920d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:20.947308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.948363 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a77c4991-0d60-4a70-8180-b1d4635d0a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:20.953281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 987/1962] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:20 2022] DELETE /identity/v3/projects/36537646071d4cd3b4309820b34920d4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:20.962421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34054054-a8a7-4f13-abf3-5b8d8549f6d3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:20.963077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34054054-a8a7-4f13-abf3-5b8d8549f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:20.963650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34054054-a8a7-4f13-abf3-5b8d8549f6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:21.022064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-34054054-a8a7-4f13-abf3-5b8d8549f6d3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:21.023731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-34054054-a8a7-4f13-abf3-5b8d8549f6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:21.146218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 976/1963] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:21.162564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f344e-df98-42ca-9d89-cec0520f7190 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:21.163905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f344e-df98-42ca-9d89-cec0520f7190 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:21.164766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f344e-df98-42ca-9d89-cec0520f7190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:21.198611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-679f344e-df98-42ca-9d89-cec0520f7190 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:21.201529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-679f344e-df98-42ca-9d89-cec0520f7190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:21.224847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34054054-a8a7-4f13-abf3-5b8d8549f6d3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:21.236103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 988/1964] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:21.236561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34054054-a8a7-4f13-abf3-5b8d8549f6d3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:21.243564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec43a6c-5601-4fe2-8a8b-34d8cd0b19e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:21.244512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec43a6c-5601-4fe2-8a8b-34d8cd0b19e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:21.244798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec43a6c-5601-4fe2-8a8b-34d8cd0b19e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:21.245201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec43a6c-5601-4fe2-8a8b-34d8cd0b19e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:21.247151 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec43a6c-5601-4fe2-8a8b-34d8cd0b19e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:21.247517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec43a6c-5601-4fe2-8a8b-34d8cd0b19e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:21.249263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec43a6c-5601-4fe2-8a8b-34d8cd0b19e2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:21.272202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f344e-df98-42ca-9d89-cec0520f7190 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:21.278579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 977/1965] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:21.290881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f344e-df98-42ca-9d89-cec0520f7190 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:21.311171 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c4adb-a50b-41aa-88e9-3c83f4167ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:21.313346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c4adb-a50b-41aa-88e9-3c83f4167ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:21.314263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c4adb-a50b-41aa-88e9-3c83f4167ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:21.315006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c4adb-a50b-41aa-88e9-3c83f4167ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:21.316243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c4adb-a50b-41aa-88e9-3c83f4167ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:21.318970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c4adb-a50b-41aa-88e9-3c83f4167ad9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:21.364426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 989/1966] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:21 2022] POST /identity/v3/projects => generated 357 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:21.365673 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec43a6c-5601-4fe2-8a8b-34d8cd0b19e2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:21.385271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec43a6c-5601-4fe2-8a8b-34d8cd0b19e2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:21.486486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cf51d-2b19-4377-9ab4-c4e2cecfa9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:21.487803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf51d-2b19-4377-9ab4-c4e2cecfa9ea admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:21.488112 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf51d-2b19-4377-9ab4-c4e2cecfa9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:21.488392 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cf51d-2b19-4377-9ab4-c4e2cecfa9ea admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:21.489123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cf51d-2b19-4377-9ab4-c4e2cecfa9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:21.491578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cf51d-2b19-4377-9ab4-c4e2cecfa9ea admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:21.519462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 978/1967] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:21 2022] POST /identity/v3/users => generated 279 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:21.525394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c4adb-a50b-41aa-88e9-3c83f4167ad9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:21.538662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c4adb-a50b-41aa-88e9-3c83f4167ad9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:21.545113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452c2f5-9126-47c4-ad46-9d535856ed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:21.546337 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452c2f5-9126-47c4-ad46-9d535856ed11 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:21.546898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452c2f5-9126-47c4-ad46-9d535856ed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:21.547458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452c2f5-9126-47c4-ad46-9d535856ed11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:21.548909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452c2f5-9126-47c4-ad46-9d535856ed11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:21.551845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452c2f5-9126-47c4-ad46-9d535856ed11 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:21.553323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cf51d-2b19-4377-9ab4-c4e2cecfa9ea admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:21.563181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8c7cf51d-2b19-4377-9ab4-c4e2cecfa9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:21.573525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 990/1968] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:21.575522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452c2f5-9126-47c4-ad46-9d535856ed11 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:21.590570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cf51d-2b19-4377-9ab4-c4e2cecfa9ea admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:21.593268 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452c2f5-9126-47c4-ad46-9d535856ed11 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:21.603254 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:21.604190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:21.604452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:21.605152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] PATH_INFO: `/v3/projects/008a2499546e4737a380201791f5216c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:21.614036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31d083-a6e8-43bd-a8ac-8fc604e516af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:21.614218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=008a2499546e4737a380201791f5216c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:21.614349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31d083-a6e8-43bd-a8ac-8fc604e516af admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:21.614349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31d083-a6e8-43bd-a8ac-8fc604e516af admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:21.614349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31d083-a6e8-43bd-a8ac-8fc604e516af admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:21.614711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31d083-a6e8-43bd-a8ac-8fc604e516af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:21.614795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:21.627695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31d083-a6e8-43bd-a8ac-8fc604e516af admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:21.672596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 991/1969] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:21.673878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31d083-a6e8-43bd-a8ac-8fc604e516af admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:21.686357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31d083-a6e8-43bd-a8ac-8fc604e516af admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:21.693533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f03ab-f1eb-4574-ad6f-c3c828a87e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:21.694594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f03ab-f1eb-4574-ad6f-c3c828a87e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:21.695006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f03ab-f1eb-4574-ad6f-c3c828a87e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:21.695353 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f03ab-f1eb-4574-ad6f-c3c828a87e00 admin admin] PATH_INFO: `/v3/projects/561a159da877463da86541b07e292991/users/6d8e2514c53d42acb9ebd7695660bf61/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:21.729947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f03ab-f1eb-4574-ad6f-c3c828a87e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561a159da877463da86541b07e292991, user_id=6d8e2514c53d42acb9ebd7695660bf61, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:21.732800 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f03ab-f1eb-4574-ad6f-c3c828a87e00 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:21.750073 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008a2499546e4737a380201791f5216c', 'request_id': 'req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:21.759061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 992/1970] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:21 2022] PUT /identity/v3/projects/561a159da877463da86541b07e292991/users/6d8e2514c53d42acb9ebd7695660bf61/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:21.767504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008a2499546e4737a380201791f5216c', 'request_id': 'req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:21.772137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c1636-d558-4549-9b66-22c1f45ce824 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:21.772934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c1636-d558-4549-9b66-22c1f45ce824 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:21.773437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c1636-d558-4549-9b66-22c1f45ce824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:21.784266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008a2499546e4737a380201791f5216c', 'request_id': 'req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:21.813638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] The token cache is being invalidate because project 008a2499546e4737a380201791f5216c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:21.814026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:21.818564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:21.820479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 979/1971] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:21 2022] DELETE /identity/v3/projects/008a2499546e4737a380201791f5216c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:21.826353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:21.828077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:21.834670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-c18c1636-d558-4549-9b66-22c1f45ce824 None None] MFA Rules not processed for user `6d8e2514c53d42acb9ebd7695660bf61`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:21.836641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c18c1636-d558-4549-9b66-22c1f45ce824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:21.950520 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18e5f-f0d1-4a01-a532-f4b1bd4bc939 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:21.967396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 993/1972] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:21.973752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c1636-d558-4549-9b66-22c1f45ce824 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:21.976186 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c18c1636-d558-4549-9b66-22c1f45ce824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:22.061335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:22.062911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:22.062911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:22.062911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] PATH_INFO: `/v3/users/3aaf8f46d0604dd9af58cdf4792d06ef` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:22.064095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aaf8f46d0604dd9af58cdf4792d06ef)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:22.066335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:22.091568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c1636-d558-4549-9b66-22c1f45ce824 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:22.097622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279697c0-8256-488c-aa6f-d18147066c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:22.098312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279697c0-8256-488c-aa6f-d18147066c3c admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:22.098594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279697c0-8256-488c-aa6f-d18147066c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:22.098964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279697c0-8256-488c-aa6f-d18147066c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:22.100009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279697c0-8256-488c-aa6f-d18147066c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:22.102464 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279697c0-8256-488c-aa6f-d18147066c3c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:22.141832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 994/1973] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:21 2022] POST /identity/v3/projects => generated 357 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:22.142683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aaf8f46d0604dd9af58cdf4792d06ef'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:22.143551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279697c0-8256-488c-aa6f-d18147066c3c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:22.156973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aaf8f46d0604dd9af58cdf4792d06ef'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:22.178047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aaf8f46d0604dd9af58cdf4792d06ef'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:22.179302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aaf8f46d0604dd9af58cdf4792d06ef'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:22.192820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aaf8f46d0604dd9af58cdf4792d06ef'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:22.204084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 980/1974] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:21 2022] DELETE /identity/v3/users/3aaf8f46d0604dd9af58cdf4792d06ef => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:22.253001 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279697c0-8256-488c-aa6f-d18147066c3c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:22.367473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c50d85-dacb-4d29-9883-3913232a0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:22.368626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c50d85-dacb-4d29-9883-3913232a0e73 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:22.369125 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c50d85-dacb-4d29-9883-3913232a0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:22.369675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c50d85-dacb-4d29-9883-3913232a0e73 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:22.371503 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c50d85-dacb-4d29-9883-3913232a0e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:22.379355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c50d85-dacb-4d29-9883-3913232a0e73 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:22.429536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 995/1975] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:22 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:22.432932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:22.435157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:22.470621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72d11b-36df-4e73-87ce-c17e69e773b0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:22.477725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b07dc-b9d3-4190-aa55-30191563745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:22.478397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b07dc-b9d3-4190-aa55-30191563745c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:22.478669 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b07dc-b9d3-4190-aa55-30191563745c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:22.478933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b07dc-b9d3-4190-aa55-30191563745c admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:22.479824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b07dc-b9d3-4190-aa55-30191563745c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:22.481707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b07dc-b9d3-4190-aa55-30191563745c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:22.495429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 981/1976] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:22.502829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c50d85-dacb-4d29-9883-3913232a0e73 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:22.520734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c50d85-dacb-4d29-9883-3913232a0e73 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:22.549965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e5aa5-527b-4b63-9d3f-023090500f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:22.552746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5aa5-527b-4b63-9d3f-023090500f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:22.553276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5aa5-527b-4b63-9d3f-023090500f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:22.553784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e5aa5-527b-4b63-9d3f-023090500f03 admin admin] PATH_INFO: `/v3/projects/a74f9db07bd04527b1e0080a65dc1aaa/users/4d12986de55a4706b571ca732df751f5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:22.592965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e5aa5-527b-4b63-9d3f-023090500f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74f9db07bd04527b1e0080a65dc1aaa, user_id=4d12986de55a4706b571ca732df751f5, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:22.598945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e5aa5-527b-4b63-9d3f-023090500f03 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:22.627744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 996/1977] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:22 2022] PUT /identity/v3/projects/a74f9db07bd04527b1e0080a65dc1aaa/users/4d12986de55a4706b571ca732df751f5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:22.631658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b07dc-b9d3-4190-aa55-30191563745c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:22.642695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b07dc-b9d3-4190-aa55-30191563745c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:22.740772 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22eba0-e4c0-4d16-8309-0a23ccb80b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:22.742025 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22eba0-e4c0-4d16-8309-0a23ccb80b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:22.742452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22eba0-e4c0-4d16-8309-0a23ccb80b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:22.742932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22eba0-e4c0-4d16-8309-0a23ccb80b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:22.744359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22eba0-e4c0-4d16-8309-0a23ccb80b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:22.747601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22eba0-e4c0-4d16-8309-0a23ccb80b8b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:22.764037 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 982/1978] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:22.769608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e5aa5-527b-4b63-9d3f-023090500f03 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:22.787675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e5aa5-527b-4b63-9d3f-023090500f03 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:22.796277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e85c94-dd4a-40da-9d25-cd6251b90bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:22.798054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e85c94-dd4a-40da-9d25-cd6251b90bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:22.798605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e85c94-dd4a-40da-9d25-cd6251b90bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:22.799141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e85c94-dd4a-40da-9d25-cd6251b90bfc admin admin] PATH_INFO: `/v3/projects/a74f9db07bd04527b1e0080a65dc1aaa/users/4d12986de55a4706b571ca732df751f5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:22.803129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e85c94-dd4a-40da-9d25-cd6251b90bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74f9db07bd04527b1e0080a65dc1aaa, user_id=4d12986de55a4706b571ca732df751f5, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:22.808458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e85c94-dd4a-40da-9d25-cd6251b90bfc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:22.826036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 997/1979] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:22 2022] PUT /identity/v3/projects/a74f9db07bd04527b1e0080a65dc1aaa/users/4d12986de55a4706b571ca732df751f5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:22.844802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c245c-7f01-4304-a035-b577495e57a1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:22.845316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c245c-7f01-4304-a035-b577495e57a1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:22.845752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c245c-7f01-4304-a035-b577495e57a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:22.889019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-489c245c-7f01-4304-a035-b577495e57a1 None None] MFA Rules not processed for user `4d12986de55a4706b571ca732df751f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:22.890895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-489c245c-7f01-4304-a035-b577495e57a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:23.025137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 983/1980] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:23.043799 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e85c94-dd4a-40da-9d25-cd6251b90bfc admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:23.046750 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-54e85c94-dd4a-40da-9d25-cd6251b90bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:23.140052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e85c94-dd4a-40da-9d25-cd6251b90bfc admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:23.144154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16739fc3-a843-47c3-a713-f858d4510dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:23.144823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16739fc3-a843-47c3-a713-f858d4510dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:23.145107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16739fc3-a843-47c3-a713-f858d4510dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:23.145431 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16739fc3-a843-47c3-a713-f858d4510dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:23.162266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16739fc3-a843-47c3-a713-f858d4510dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:23.164995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16739fc3-a843-47c3-a713-f858d4510dc8 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:23.182804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 998/1981] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:23 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:23.329655 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c245c-7f01-4304-a035-b577495e57a1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:23.347441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c245c-7f01-4304-a035-b577495e57a1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:23.353690 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9225e25-f018-427d-9b38-bf811721cb6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:23.355195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225e25-f018-427d-9b38-bf811721cb6a service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:23.355649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225e25-f018-427d-9b38-bf811721cb6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:23.356080 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9225e25-f018-427d-9b38-bf811721cb6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:23.359445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d9225e25-f018-427d-9b38-bf811721cb6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:23.428758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16739fc3-a843-47c3-a713-f858d4510dc8 service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:23.431472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-16739fc3-a843-47c3-a713-f858d4510dc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:23.524801 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9225e25-f018-427d-9b38-bf811721cb6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:23.526311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9225e25-f018-427d-9b38-bf811721cb6a service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:23.539824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 984/1982] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:23 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:23.578258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16739fc3-a843-47c3-a713-f858d4510dc8 service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:23.595160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:23.596062 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:23.596342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:23.596618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] PATH_INFO: `/v3/projects/83a7176ecb0646b3a74e87a9c40b91e9` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:23.598601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a7176ecb0646b3a74e87a9c40b91e9)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:23.600264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:23.704194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a7176ecb0646b3a74e87a9c40b91e9', 'request_id': 'req-909ade35-9e29-41ec-87a8-be7d631a86b7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:23.712713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a7176ecb0646b3a74e87a9c40b91e9', 'request_id': 'req-909ade35-9e29-41ec-87a8-be7d631a86b7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:23.719210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a7176ecb0646b3a74e87a9c40b91e9', 'request_id': 'req-909ade35-9e29-41ec-87a8-be7d631a86b7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:23.758839 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] The token cache is being invalidate because project 83a7176ecb0646b3a74e87a9c40b91e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:23.759495 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:23.761683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:23.763855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 999/1983] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:23 2022] DELETE /identity/v3/projects/83a7176ecb0646b3a74e87a9c40b91e9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:23.768789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9225e25-f018-427d-9b38-bf811721cb6a service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:23.782438 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9225e25-f018-427d-9b38-bf811721cb6a service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:23.906962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:23.908772 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:23.909348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:23.909790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] PATH_INFO: `/v3/users/073cb489f01940989232f54f5258398c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:23.912048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073cb489f01940989232f54f5258398c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:23.915751 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:23.997717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073cb489f01940989232f54f5258398c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:24.005387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073cb489f01940989232f54f5258398c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:24.024070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073cb489f01940989232f54f5258398c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:24.025302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073cb489f01940989232f54f5258398c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:24.036361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a84b755e-b50c-4cef-854f-b5afdbef1163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073cb489f01940989232f54f5258398c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:24.044801 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 985/1984] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:23 2022] DELETE /identity/v3/users/073cb489f01940989232f54f5258398c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:24.449179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:24.452117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:24.475600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ade35-9e29-41ec-87a8-be7d631a86b7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:24.557652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:24.558949 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:24.559440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:24.559559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] PATH_INFO: `/v3/projects/622d4c79a3da4f80ac68d090938f6f48` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:24.560787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=622d4c79a3da4f80ac68d090938f6f48)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:24.562819 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:24.646609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622d4c79a3da4f80ac68d090938f6f48', 'request_id': 'req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:24.658964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622d4c79a3da4f80ac68d090938f6f48', 'request_id': 'req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:24.670443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622d4c79a3da4f80ac68d090938f6f48', 'request_id': 'req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:24.692491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] The token cache is being invalidate because project 622d4c79a3da4f80ac68d090938f6f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:24.692842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:24.693513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-2d69e7ed-84ca-4562-9418-5d633d0f5f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:24.703176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1000/1985] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:24 2022] DELETE /identity/v3/projects/622d4c79a3da4f80ac68d090938f6f48 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:24.708182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e42dd2-7d1c-44ff-ae91-2e1ec73f1e14 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:24.708839 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e42dd2-7d1c-44ff-ae91-2e1ec73f1e14 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:24.709567 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e42dd2-7d1c-44ff-ae91-2e1ec73f1e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:24.755200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-80e42dd2-7d1c-44ff-ae91-2e1ec73f1e14 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:24.757932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-80e42dd2-7d1c-44ff-ae91-2e1ec73f1e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:24.863195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 986/1986] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:24.878282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc4fcc-0c82-4b5b-a558-c842c9a6e7b3 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:24.878282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc4fcc-0c82-4b5b-a558-c842c9a6e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:24.878282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc4fcc-0c82-4b5b-a558-c842c9a6e7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:24.936528 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1dcc4fcc-0c82-4b5b-a558-c842c9a6e7b3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:24.938892 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1dcc4fcc-0c82-4b5b-a558-c842c9a6e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:24.961833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1001/1987] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:24.967998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e42dd2-7d1c-44ff-ae91-2e1ec73f1e14 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:25.000777 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e42dd2-7d1c-44ff-ae91-2e1ec73f1e14 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:25.008336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b73105-8b36-4a7c-b814-91e0963fa1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:25.010150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73105-8b36-4a7c-b814-91e0963fa1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:25.010632 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73105-8b36-4a7c-b814-91e0963fa1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:25.011122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b73105-8b36-4a7c-b814-91e0963fa1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:25.012174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b73105-8b36-4a7c-b814-91e0963fa1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:25.012637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b73105-8b36-4a7c-b814-91e0963fa1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:25.014500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b73105-8b36-4a7c-b814-91e0963fa1a8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:25.036058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 987/1988] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:25.043325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc4fcc-0c82-4b5b-a558-c842c9a6e7b3 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:25.057169 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc4fcc-0c82-4b5b-a558-c842c9a6e7b3 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:25.065296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d7f03-d859-4738-9978-75bc6e989389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:25.066861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d7f03-d859-4738-9978-75bc6e989389 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:25.067532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d7f03-d859-4738-9978-75bc6e989389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:25.068053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d7f03-d859-4738-9978-75bc6e989389 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:25.069985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d7f03-d859-4738-9978-75bc6e989389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:25.073459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d7f03-d859-4738-9978-75bc6e989389 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:25.115447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1002/1989] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:25 2022] POST /identity/v3/projects => generated 407 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:25.120938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b73105-8b36-4a7c-b814-91e0963fa1a8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:25.143427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b73105-8b36-4a7c-b814-91e0963fa1a8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:25.238393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496a2c-ec19-4f70-81d6-6ce7dcf129bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:25.239561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496a2c-ec19-4f70-81d6-6ce7dcf129bf admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:25.240059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496a2c-ec19-4f70-81d6-6ce7dcf129bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:25.240514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c496a2c-ec19-4f70-81d6-6ce7dcf129bf admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:25.241769 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c496a2c-ec19-4f70-81d6-6ce7dcf129bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:25.245460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c496a2c-ec19-4f70-81d6-6ce7dcf129bf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:25.275159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 988/1990] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:25 2022] POST /identity/v3/users => generated 304 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:25.279560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d7f03-d859-4738-9978-75bc6e989389 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:25.293280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d7f03-d859-4738-9978-75bc6e989389 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:25.304433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286016-8237-4ee7-a6ef-1e7e11b1dd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:25.305248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286016-8237-4ee7-a6ef-1e7e11b1dd70 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:25.305600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286016-8237-4ee7-a6ef-1e7e11b1dd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:25.305963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286016-8237-4ee7-a6ef-1e7e11b1dd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:25.306910 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8286016-8237-4ee7-a6ef-1e7e11b1dd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:25.309505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8286016-8237-4ee7-a6ef-1e7e11b1dd70 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:25.322797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1003/1991] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:25.328161 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496a2c-ec19-4f70-81d6-6ce7dcf129bf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:25.339120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c496a2c-ec19-4f70-81d6-6ce7dcf129bf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:25.344568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b86e3-d36d-4d54-acdf-028ce923a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:25.345282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b86e3-d36d-4d54-acdf-028ce923a668 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:25.345568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b86e3-d36d-4d54-acdf-028ce923a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:25.345837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b86e3-d36d-4d54-acdf-028ce923a668 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:25.346623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b86e3-d36d-4d54-acdf-028ce923a668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:25.348241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b86e3-d36d-4d54-acdf-028ce923a668 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:25.377502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 989/1992] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:25.382881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286016-8237-4ee7-a6ef-1e7e11b1dd70 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:25.402285 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286016-8237-4ee7-a6ef-1e7e11b1dd70 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:25.411855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847d65-40e7-4289-89cd-b954dfd69fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:25.413023 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847d65-40e7-4289-89cd-b954dfd69fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:25.413414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847d65-40e7-4289-89cd-b954dfd69fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:25.414113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b847d65-40e7-4289-89cd-b954dfd69fe9 admin admin] PATH_INFO: `/v3/projects/14c4c50280d446abaa52f007f214c13d/users/d72e91b5ff814a888209d39361f23ecf/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:25.437291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b847d65-40e7-4289-89cd-b954dfd69fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c4c50280d446abaa52f007f214c13d, user_id=d72e91b5ff814a888209d39361f23ecf, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:25.443529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b847d65-40e7-4289-89cd-b954dfd69fe9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:25.460798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1004/1993] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:25 2022] PUT /identity/v3/projects/14c4c50280d446abaa52f007f214c13d/users/d72e91b5ff814a888209d39361f23ecf/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:25.473848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27687eaf-a15d-49c9-8d6d-85888a2253bd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:25.474322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27687eaf-a15d-49c9-8d6d-85888a2253bd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:25.474789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27687eaf-a15d-49c9-8d6d-85888a2253bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:25.526616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-27687eaf-a15d-49c9-8d6d-85888a2253bd None None] MFA Rules not processed for user `d72e91b5ff814a888209d39361f23ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:25.528558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-27687eaf-a15d-49c9-8d6d-85888a2253bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:25.665803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 990/1994] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:25.667574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847d65-40e7-4289-89cd-b954dfd69fe9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:25.813811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b847d65-40e7-4289-89cd-b954dfd69fe9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:25.834362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2f091-6896-4b42-bb08-7ad0748f0c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:25.835785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2f091-6896-4b42-bb08-7ad0748f0c31 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:25.836309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2f091-6896-4b42-bb08-7ad0748f0c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:25.836856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2f091-6896-4b42-bb08-7ad0748f0c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:25.838300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2f091-6896-4b42-bb08-7ad0748f0c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:25.845312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2f091-6896-4b42-bb08-7ad0748f0c31 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:25.899075 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1005/1995] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:25 2022] POST /identity/v3/projects => generated 409 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:25.899966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27687eaf-a15d-49c9-8d6d-85888a2253bd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:25.917573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27687eaf-a15d-49c9-8d6d-85888a2253bd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:26.027301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94318eb5-76b0-4897-a14f-57018cd203df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:26.028526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94318eb5-76b0-4897-a14f-57018cd203df admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:26.028962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94318eb5-76b0-4897-a14f-57018cd203df admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:26.029562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94318eb5-76b0-4897-a14f-57018cd203df admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:26.030929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94318eb5-76b0-4897-a14f-57018cd203df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:26.034740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94318eb5-76b0-4897-a14f-57018cd203df admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:26.068080 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 991/1996] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:25 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:26.073263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2f091-6896-4b42-bb08-7ad0748f0c31 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:26.089276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2f091-6896-4b42-bb08-7ad0748f0c31 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:26.095623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e8d34-82b3-4639-b522-9cee9634895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:26.096418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e8d34-82b3-4639-b522-9cee9634895d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:26.096705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e8d34-82b3-4639-b522-9cee9634895d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:26.097131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e8d34-82b3-4639-b522-9cee9634895d admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:26.097885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e8d34-82b3-4639-b522-9cee9634895d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:26.100612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e8d34-82b3-4639-b522-9cee9634895d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:26.119360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1006/1997] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:26.120846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94318eb5-76b0-4897-a14f-57018cd203df admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:26.142258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94318eb5-76b0-4897-a14f-57018cd203df admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:26.158881 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9346f-af46-4a9d-a312-dd2f2bcd55ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:26.160514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9346f-af46-4a9d-a312-dd2f2bcd55ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:26.161045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9346f-af46-4a9d-a312-dd2f2bcd55ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:26.161609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9346f-af46-4a9d-a312-dd2f2bcd55ed admin admin] PATH_INFO: `/v3/projects/c0284017d92d4c1ca1c9f466a0b48367/users/bd3e156ec46144aa98de1cc889ff4292/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:26.196058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9346f-af46-4a9d-a312-dd2f2bcd55ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0284017d92d4c1ca1c9f466a0b48367, user_id=bd3e156ec46144aa98de1cc889ff4292, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:26.201179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c9346f-af46-4a9d-a312-dd2f2bcd55ed admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:26.237368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 992/1998] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:26 2022] PUT /identity/v3/projects/c0284017d92d4c1ca1c9f466a0b48367/users/bd3e156ec46144aa98de1cc889ff4292/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:26.238449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e8d34-82b3-4639-b522-9cee9634895d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:26.257989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e8d34-82b3-4639-b522-9cee9634895d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:26.391524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62e52e-c51c-45de-ba89-1ef9bdf69918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:26.393589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62e52e-c51c-45de-ba89-1ef9bdf69918 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:26.394572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62e52e-c51c-45de-ba89-1ef9bdf69918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:26.395055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62e52e-c51c-45de-ba89-1ef9bdf69918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:26.402379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62e52e-c51c-45de-ba89-1ef9bdf69918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:26.402379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62e52e-c51c-45de-ba89-1ef9bdf69918 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:26.412003 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1007/1999] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:26.417455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9346f-af46-4a9d-a312-dd2f2bcd55ed admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:26.439376 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9346f-af46-4a9d-a312-dd2f2bcd55ed admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:26.462672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0a47-3303-47bc-a93f-003393884cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:26.463728 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0a47-3303-47bc-a93f-003393884cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:26.464100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0a47-3303-47bc-a93f-003393884cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:26.464362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0a47-3303-47bc-a93f-003393884cd8 admin admin] PATH_INFO: `/v3/projects/c0284017d92d4c1ca1c9f466a0b48367/users/bd3e156ec46144aa98de1cc889ff4292/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:26.466637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe0a47-3303-47bc-a93f-003393884cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0284017d92d4c1ca1c9f466a0b48367, user_id=bd3e156ec46144aa98de1cc889ff4292, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:26.469533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe0a47-3303-47bc-a93f-003393884cd8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:26.500504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 993/2000] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:26 2022] PUT /identity/v3/projects/c0284017d92d4c1ca1c9f466a0b48367/users/bd3e156ec46144aa98de1cc889ff4292/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:26.512688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad1df-a54c-4a1b-b19a-ff500eca132d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:26.513390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad1df-a54c-4a1b-b19a-ff500eca132d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:26.513390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad1df-a54c-4a1b-b19a-ff500eca132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:26.547435 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9c6ad1df-a54c-4a1b-b19a-ff500eca132d None None] MFA Rules not processed for user `bd3e156ec46144aa98de1cc889ff4292`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:26.549924 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9c6ad1df-a54c-4a1b-b19a-ff500eca132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:26.673045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1008/2001] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:26.689362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0a47-3303-47bc-a93f-003393884cd8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:26.692792 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-aafe0a47-3303-47bc-a93f-003393884cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:26.819484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0a47-3303-47bc-a93f-003393884cd8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:26.826018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d78c0f-552e-418d-bb85-4c7bcffe5633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:26.826944 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d78c0f-552e-418d-bb85-4c7bcffe5633 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:26.827229 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d78c0f-552e-418d-bb85-4c7bcffe5633 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:26.827872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d78c0f-552e-418d-bb85-4c7bcffe5633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:26.847370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d78c0f-552e-418d-bb85-4c7bcffe5633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:26.850177 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d78c0f-552e-418d-bb85-4c7bcffe5633 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:26.870352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 994/2002] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:27.074095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ad1df-a54c-4a1b-b19a-ff500eca132d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:27.084793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ad1df-a54c-4a1b-b19a-ff500eca132d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:27.088686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cfc75-52ab-4a1d-be3c-3cc209203f92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:27.089449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cfc75-52ab-4a1d-be3c-3cc209203f92 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:27.089703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cfc75-52ab-4a1d-be3c-3cc209203f92 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:27.090016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cfc75-52ab-4a1d-be3c-3cc209203f92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:27.182834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cfc75-52ab-4a1d-be3c-3cc209203f92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:27.185741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cfc75-52ab-4a1d-be3c-3cc209203f92 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:27.200056 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1009/2003] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:36.413624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d78c0f-552e-418d-bb85-4c7bcffe5633 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:36.546848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d78c0f-552e-418d-bb85-4c7bcffe5633 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:36.554237 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:36.555613 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:36.556044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:36.556464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] PATH_INFO: `/v3/users/d72e91b5ff814a888209d39361f23ecf` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:36.558699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72e91b5ff814a888209d39361f23ecf)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:36.562536 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:36.648285 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72e91b5ff814a888209d39361f23ecf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:36.660590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72e91b5ff814a888209d39361f23ecf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:36.681525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72e91b5ff814a888209d39361f23ecf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:36.682426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72e91b5ff814a888209d39361f23ecf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:36.703319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72e91b5ff814a888209d39361f23ecf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:36.717121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 995/2004] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:36 2022] DELETE /identity/v3/users/d72e91b5ff814a888209d39361f23ecf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:36.725704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe72c9-6804-4c7b-b0e0-b10462f9212d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:36.727243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe72c9-6804-4c7b-b0e0-b10462f9212d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:36.728119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe72c9-6804-4c7b-b0e0-b10462f9212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:36.764482 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e7fe72c9-6804-4c7b-b0e0-b10462f9212d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:36.767701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e7fe72c9-6804-4c7b-b0e0-b10462f9212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:36.935360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1010/2005] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:36.951116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:36.953093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:37.116103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25891e8c-f2ab-4f8a-9cbc-77766dc641a0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:37.122713 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50140d6-83b9-4478-85ee-1a6cb0559b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:37.123842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50140d6-83b9-4478-85ee-1a6cb0559b9e service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:37.124393 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50140d6-83b9-4478-85ee-1a6cb0559b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:37.124784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50140d6-83b9-4478-85ee-1a6cb0559b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:37.140369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50140d6-83b9-4478-85ee-1a6cb0559b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:37.143610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50140d6-83b9-4478-85ee-1a6cb0559b9e service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:37.156582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 996/2006] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:37.637486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe72c9-6804-4c7b-b0e0-b10462f9212d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:37.639302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e7fe72c9-6804-4c7b-b0e0-b10462f9212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:37.668029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe72c9-6804-4c7b-b0e0-b10462f9212d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:37.677812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:37.681609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:37.682198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:37.682767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] PATH_INFO: `/v3/projects/14c4c50280d446abaa52f007f214c13d` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:37.690076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c4c50280d446abaa52f007f214c13d)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:37.694260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:37.811733 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c4c50280d446abaa52f007f214c13d', 'request_id': 'req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:37.824769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c4c50280d446abaa52f007f214c13d', 'request_id': 'req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:37.840703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c4c50280d446abaa52f007f214c13d', 'request_id': 'req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:37.866104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] The token cache is being invalidate because project 14c4c50280d446abaa52f007f214c13d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:37.866471 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:37.867653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:37.870146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1011/2007] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:37 2022] DELETE /identity/v3/projects/14c4c50280d446abaa52f007f214c13d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:37.877261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50140d6-83b9-4478-85ee-1a6cb0559b9e service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:37.898621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50140d6-83b9-4478-85ee-1a6cb0559b9e service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:38.003318 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:38.004415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:38.004900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:38.005215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] PATH_INFO: `/v3/users/bd3e156ec46144aa98de1cc889ff4292` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:38.006898 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd3e156ec46144aa98de1cc889ff4292)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:38.009003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:38.093462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd3e156ec46144aa98de1cc889ff4292'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:38.106388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd3e156ec46144aa98de1cc889ff4292'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:38.128938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd3e156ec46144aa98de1cc889ff4292'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:38.129830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd3e156ec46144aa98de1cc889ff4292'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:38.143266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f3865bc5-e394-4124-ad10-02f9fde1b795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd3e156ec46144aa98de1cc889ff4292'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:38.165250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 997/2008] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:37 2022] DELETE /identity/v3/users/bd3e156ec46144aa98de1cc889ff4292 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:38.652901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:38.654972 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:38.677466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965f44b-cbcb-4945-bbcb-1c1523d0cd11 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:38.753747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:38.754711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:38.754991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:38.755261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] PATH_INFO: `/v3/projects/c0284017d92d4c1ca1c9f466a0b48367` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:38.756528 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0284017d92d4c1ca1c9f466a0b48367)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:38.758484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:38.907042 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0284017d92d4c1ca1c9f466a0b48367', 'request_id': 'req-e513c5cf-7e83-4b1a-8f56-b054793ddf98'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:38.919046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0284017d92d4c1ca1c9f466a0b48367', 'request_id': 'req-e513c5cf-7e83-4b1a-8f56-b054793ddf98'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:38.927922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0284017d92d4c1ca1c9f466a0b48367', 'request_id': 'req-e513c5cf-7e83-4b1a-8f56-b054793ddf98'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:38.950707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] The token cache is being invalidate because project c0284017d92d4c1ca1c9f466a0b48367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:38.951290 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:38.952449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e513c5cf-7e83-4b1a-8f56-b054793ddf98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:38.955360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1012/2009] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:38 2022] DELETE /identity/v3/projects/c0284017d92d4c1ca1c9f466a0b48367 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:38.963720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11396529-bbd0-49d7-af98-7c57ec80d1e1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:38.964475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11396529-bbd0-49d7-af98-7c57ec80d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:38.964876 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11396529-bbd0-49d7-af98-7c57ec80d1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:38.994562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-11396529-bbd0-49d7-af98-7c57ec80d1e1 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:38.996525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-11396529-bbd0-49d7-af98-7c57ec80d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:39.075784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 998/2010] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:39.086672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbd79e-aada-4b25-81db-5e3521a92d27 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:39.087264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbd79e-aada-4b25-81db-5e3521a92d27 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:39.087639 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbd79e-aada-4b25-81db-5e3521a92d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:39.110683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-99bbd79e-aada-4b25-81db-5e3521a92d27 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:39.112207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-99bbd79e-aada-4b25-81db-5e3521a92d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:39.122751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1013/2011] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:39.129145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11396529-bbd0-49d7-af98-7c57ec80d1e1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:39.147629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11396529-bbd0-49d7-af98-7c57ec80d1e1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:39.159988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfc779-8e64-4ff7-a35a-6b2414b82569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:39.160995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfc779-8e64-4ff7-a35a-6b2414b82569 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:39.161823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfc779-8e64-4ff7-a35a-6b2414b82569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:39.167075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfc779-8e64-4ff7-a35a-6b2414b82569 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:39.167075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfc779-8e64-4ff7-a35a-6b2414b82569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:39.167075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfc779-8e64-4ff7-a35a-6b2414b82569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:39.167075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfc779-8e64-4ff7-a35a-6b2414b82569 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:39.196859 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 999/2012] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:39.197424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbd79e-aada-4b25-81db-5e3521a92d27 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:39.214226 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbd79e-aada-4b25-81db-5e3521a92d27 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:39.223746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105aed-acda-4dd1-92c8-ad713ddb48b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:39.225216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105aed-acda-4dd1-92c8-ad713ddb48b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:39.225872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105aed-acda-4dd1-92c8-ad713ddb48b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:39.226427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105aed-acda-4dd1-92c8-ad713ddb48b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:39.228212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105aed-acda-4dd1-92c8-ad713ddb48b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:39.231809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105aed-acda-4dd1-92c8-ad713ddb48b4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:39.298532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1014/2013] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:39 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:39.299810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfc779-8e64-4ff7-a35a-6b2414b82569 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:39.317320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfc779-8e64-4ff7-a35a-6b2414b82569 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:39.421522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1ba62-b0df-4561-bb23-27cf9e116193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:39.422661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ba62-b0df-4561-bb23-27cf9e116193 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:39.423255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ba62-b0df-4561-bb23-27cf9e116193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:39.423944 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ba62-b0df-4561-bb23-27cf9e116193 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:39.425158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1ba62-b0df-4561-bb23-27cf9e116193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:39.428969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1ba62-b0df-4561-bb23-27cf9e116193 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:39.458480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1000/2014] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:39 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:39.463502 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105aed-acda-4dd1-92c8-ad713ddb48b4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:39.477843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105aed-acda-4dd1-92c8-ad713ddb48b4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:39.484439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60976d08-6737-41c7-aa34-c487721b4b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:39.485482 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976d08-6737-41c7-aa34-c487721b4b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:39.485916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976d08-6737-41c7-aa34-c487721b4b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:39.486390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976d08-6737-41c7-aa34-c487721b4b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:39.487734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60976d08-6737-41c7-aa34-c487721b4b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:39.491992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60976d08-6737-41c7-aa34-c487721b4b98 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:39.505342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1015/2015] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:39.510843 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1ba62-b0df-4561-bb23-27cf9e116193 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:39.522802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1ba62-b0df-4561-bb23-27cf9e116193 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:39.528013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc597c-112c-47e7-8ff2-145dd072f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:39.528729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc597c-112c-47e7-8ff2-145dd072f460 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:39.529122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc597c-112c-47e7-8ff2-145dd072f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:39.529330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc597c-112c-47e7-8ff2-145dd072f460 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:39.530166 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc597c-112c-47e7-8ff2-145dd072f460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:39.531829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc597c-112c-47e7-8ff2-145dd072f460 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:39.551894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1001/2016] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:39.553988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60976d08-6737-41c7-aa34-c487721b4b98 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:39.569025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60976d08-6737-41c7-aa34-c487721b4b98 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:39.576694 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec07fb4-aa34-4b6f-83cd-2deb6d3a86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:39.578286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec07fb4-aa34-4b6f-83cd-2deb6d3a86ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:39.578766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec07fb4-aa34-4b6f-83cd-2deb6d3a86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:39.579248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec07fb4-aa34-4b6f-83cd-2deb6d3a86ea admin admin] PATH_INFO: `/v3/projects/eed5fde66fcd4dc58983eede9049d226/users/3674eab1fb4a496685f62b81e286e8ed/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:39.612163 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec07fb4-aa34-4b6f-83cd-2deb6d3a86ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed5fde66fcd4dc58983eede9049d226, user_id=3674eab1fb4a496685f62b81e286e8ed, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:39.616816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec07fb4-aa34-4b6f-83cd-2deb6d3a86ea admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:39.649362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1016/2017] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:39 2022] PUT /identity/v3/projects/eed5fde66fcd4dc58983eede9049d226/users/3674eab1fb4a496685f62b81e286e8ed/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:39.659149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b07c-440e-4456-98ac-c207f8a30ec1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:39.659587 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b07c-440e-4456-98ac-c207f8a30ec1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:39.659877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b07c-440e-4456-98ac-c207f8a30ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:39.708797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7574b07c-440e-4456-98ac-c207f8a30ec1 None None] MFA Rules not processed for user `3674eab1fb4a496685f62b81e286e8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:39.714531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7574b07c-440e-4456-98ac-c207f8a30ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:39.833139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1002/2018] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:39.840041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec07fb4-aa34-4b6f-83cd-2deb6d3a86ea admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:39.970053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec07fb4-aa34-4b6f-83cd-2deb6d3a86ea admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:39.979142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38057a8-6c3e-451a-be42-5302b1159a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:39.980352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38057a8-6c3e-451a-be42-5302b1159a8d admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:39.987689 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38057a8-6c3e-451a-be42-5302b1159a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:39.989965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38057a8-6c3e-451a-be42-5302b1159a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:39.991147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38057a8-6c3e-451a-be42-5302b1159a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:39.995608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38057a8-6c3e-451a-be42-5302b1159a8d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:40.062730 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1017/2019] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:39 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:40.068104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574b07c-440e-4456-98ac-c207f8a30ec1 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:40.080598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574b07c-440e-4456-98ac-c207f8a30ec1 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:40.171300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be322d51-ee2a-4dc5-8937-cfc698a4746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:40.172018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be322d51-ee2a-4dc5-8937-cfc698a4746a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:40.172298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be322d51-ee2a-4dc5-8937-cfc698a4746a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:40.172653 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be322d51-ee2a-4dc5-8937-cfc698a4746a admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:40.173500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be322d51-ee2a-4dc5-8937-cfc698a4746a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:40.175764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be322d51-ee2a-4dc5-8937-cfc698a4746a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:40.214182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1003/2020] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:40 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:40.219558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38057a8-6c3e-451a-be42-5302b1159a8d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:40.250434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38057a8-6c3e-451a-be42-5302b1159a8d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:40.261637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd467f6-7e7e-40d1-b37f-66c285fc1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:40.263225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd467f6-7e7e-40d1-b37f-66c285fc1681 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:40.264522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd467f6-7e7e-40d1-b37f-66c285fc1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:40.264806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd467f6-7e7e-40d1-b37f-66c285fc1681 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:40.265727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd467f6-7e7e-40d1-b37f-66c285fc1681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:40.268022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd467f6-7e7e-40d1-b37f-66c285fc1681 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:40.290990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1018/2021] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:40.292630 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be322d51-ee2a-4dc5-8937-cfc698a4746a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:40.310616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be322d51-ee2a-4dc5-8937-cfc698a4746a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:40.318589 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf8330-ff21-4970-bf20-d36dea242f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:40.320381 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf8330-ff21-4970-bf20-d36dea242f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:40.320857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf8330-ff21-4970-bf20-d36dea242f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:40.321374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf8330-ff21-4970-bf20-d36dea242f28 admin admin] PATH_INFO: `/v3/projects/b0e8a6abb9a540878011f36babe3ec2e/users/6d139d9a60384195aa8c19c6a5a812a5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:40.352503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf8330-ff21-4970-bf20-d36dea242f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e8a6abb9a540878011f36babe3ec2e, user_id=6d139d9a60384195aa8c19c6a5a812a5, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:40.373867 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf8330-ff21-4970-bf20-d36dea242f28 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:40.424353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1004/2022] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:40 2022] PUT /identity/v3/projects/b0e8a6abb9a540878011f36babe3ec2e/users/6d139d9a60384195aa8c19c6a5a812a5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:40.429900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd467f6-7e7e-40d1-b37f-66c285fc1681 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:40.459479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd467f6-7e7e-40d1-b37f-66c285fc1681 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:40.556490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf8330-ff21-4970-bf20-d36dea242f28 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:40.562298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9bdf8330-ff21-4970-bf20-d36dea242f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:40.590972 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3b35b-1d08-4616-9275-b54327fe2f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:40.592017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b35b-1d08-4616-9275-b54327fe2f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:40.592885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b35b-1d08-4616-9275-b54327fe2f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:40.593602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3b35b-1d08-4616-9275-b54327fe2f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:40.595237 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3b35b-1d08-4616-9275-b54327fe2f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:40.599141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3b35b-1d08-4616-9275-b54327fe2f84 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:40.633964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1019/2023] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:40.635735 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3b35b-1d08-4616-9275-b54327fe2f84 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:40.659106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3b35b-1d08-4616-9275-b54327fe2f84 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:40.668675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103028bc-47b8-4612-8646-8b479f108cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:40.670727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103028bc-47b8-4612-8646-8b479f108cde admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:40.671225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103028bc-47b8-4612-8646-8b479f108cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:40.671714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103028bc-47b8-4612-8646-8b479f108cde admin admin] PATH_INFO: `/v3/projects/b0e8a6abb9a540878011f36babe3ec2e/users/6d139d9a60384195aa8c19c6a5a812a5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:40.677009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103028bc-47b8-4612-8646-8b479f108cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e8a6abb9a540878011f36babe3ec2e, user_id=6d139d9a60384195aa8c19c6a5a812a5, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:40.683155 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103028bc-47b8-4612-8646-8b479f108cde admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:40.686561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf8330-ff21-4970-bf20-d36dea242f28 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:40.698805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:40.702609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:40.703105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:40.703589 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] PATH_INFO: `/v3/users/0ee6fde063b34646b4ca6d477f389002` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:40.705081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1020/2024] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:40 2022] PUT /identity/v3/projects/b0e8a6abb9a540878011f36babe3ec2e/users/6d139d9a60384195aa8c19c6a5a812a5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:40.706142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee6fde063b34646b4ca6d477f389002)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:40.711126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:40.722630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103794-f8c5-4059-a36e-8d4d82cb0ec6 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:40.723006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103794-f8c5-4059-a36e-8d4d82cb0ec6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:40.723399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a103794-f8c5-4059-a36e-8d4d82cb0ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:40.781677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-8a103794-f8c5-4059-a36e-8d4d82cb0ec6 None None] MFA Rules not processed for user `6d139d9a60384195aa8c19c6a5a812a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:40.783954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8a103794-f8c5-4059-a36e-8d4d82cb0ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:40.825981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee6fde063b34646b4ca6d477f389002'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:40.838517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee6fde063b34646b4ca6d477f389002'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:40.856260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee6fde063b34646b4ca6d477f389002'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:40.857139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee6fde063b34646b4ca6d477f389002'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:40.871406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee6fde063b34646b4ca6d477f389002'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:40.879641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1005/2025] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:40 2022] DELETE /identity/v3/users/0ee6fde063b34646b4ca6d477f389002 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:40.913808 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1021/2026] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:40.927412 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:40.929776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:41.032696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d943-8cf6-4dec-8973-26155f298514 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:41.039213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c67ebb-c545-4669-a82f-20af411082ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:41.040323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c67ebb-c545-4669-a82f-20af411082ed service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:41.040795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c67ebb-c545-4669-a82f-20af411082ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:41.041302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c67ebb-c545-4669-a82f-20af411082ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:41.134054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a103794-f8c5-4059-a36e-8d4d82cb0ec6 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:41.136321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8a103794-f8c5-4059-a36e-8d4d82cb0ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:41.151220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c67ebb-c545-4669-a82f-20af411082ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:41.154445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c67ebb-c545-4669-a82f-20af411082ed service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:41.172916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1006/2027] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:41.280835 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a103794-f8c5-4059-a36e-8d4d82cb0ec6 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:41.385544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:41.386914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:41.387891 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:41.388520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] PATH_INFO: `/v3/projects/5e75918ca77e4370a5219466a06ca9a6` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:41.390726 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e75918ca77e4370a5219466a06ca9a6)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:41.393582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:41.482292 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e75918ca77e4370a5219466a06ca9a6', 'request_id': 'req-8f182000-6127-493b-9f67-b4d1475dee6b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:41.494519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e75918ca77e4370a5219466a06ca9a6', 'request_id': 'req-8f182000-6127-493b-9f67-b4d1475dee6b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:41.502962 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e75918ca77e4370a5219466a06ca9a6', 'request_id': 'req-8f182000-6127-493b-9f67-b4d1475dee6b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:41.522474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] The token cache is being invalidate because project 5e75918ca77e4370a5219466a06ca9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:41.522999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:41.523869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8f182000-6127-493b-9f67-b4d1475dee6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:41.525880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1022/2028] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:41 2022] DELETE /identity/v3/projects/5e75918ca77e4370a5219466a06ca9a6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:41.532044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f97c71-145b-4922-99b0-9777c8b1af8e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:41.532311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f97c71-145b-4922-99b0-9777c8b1af8e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:41.532586 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f97c71-145b-4922-99b0-9777c8b1af8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:41.556890 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-74f97c71-145b-4922-99b0-9777c8b1af8e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:41.558622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-74f97c71-145b-4922-99b0-9777c8b1af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:41.666352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1007/2029] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:41.675426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcb553-2644-4b0d-ab2f-746051cafd87 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:41.675709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcb553-2644-4b0d-ab2f-746051cafd87 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:41.675983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcb553-2644-4b0d-ab2f-746051cafd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:41.701308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-33dcb553-2644-4b0d-ab2f-746051cafd87 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:41.703622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-33dcb553-2644-4b0d-ab2f-746051cafd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:41.713954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1023/2030] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:41.718674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f97c71-145b-4922-99b0-9777c8b1af8e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:41.730233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f97c71-145b-4922-99b0-9777c8b1af8e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:41.735752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52b13-e62e-437b-84cb-dc9ad2e758c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:41.736728 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52b13-e62e-437b-84cb-dc9ad2e758c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:41.736940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52b13-e62e-437b-84cb-dc9ad2e758c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:41.737214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52b13-e62e-437b-84cb-dc9ad2e758c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:41.738413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e52b13-e62e-437b-84cb-dc9ad2e758c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:41.738601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e52b13-e62e-437b-84cb-dc9ad2e758c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:41.741560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e52b13-e62e-437b-84cb-dc9ad2e758c5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:41.755616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1008/2031] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:26:41.761463 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcb553-2644-4b0d-ab2f-746051cafd87 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:41.772693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcb553-2644-4b0d-ab2f-746051cafd87 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:41.778151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fa28a-5c33-4ff3-a995-a43222f0dd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:41.778839 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa28a-5c33-4ff3-a995-a43222f0dd5e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:41.779123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa28a-5c33-4ff3-a995-a43222f0dd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:41.779393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fa28a-5c33-4ff3-a995-a43222f0dd5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:41.780130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fa28a-5c33-4ff3-a995-a43222f0dd5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:41.782127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fa28a-5c33-4ff3-a995-a43222f0dd5e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:41.818017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1024/2032] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:41 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:41.824233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52b13-e62e-437b-84cb-dc9ad2e758c5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:41.846371 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52b13-e62e-437b-84cb-dc9ad2e758c5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:42.000539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bef36-19c3-4ef8-b2e4-6f9d04a46997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:42.001658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bef36-19c3-4ef8-b2e4-6f9d04a46997 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:42.002446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bef36-19c3-4ef8-b2e4-6f9d04a46997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:42.002837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bef36-19c3-4ef8-b2e4-6f9d04a46997 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:42.004271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bef36-19c3-4ef8-b2e4-6f9d04a46997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:42.006624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bef36-19c3-4ef8-b2e4-6f9d04a46997 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:42.043454 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1009/2033] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:41 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:42.050344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fa28a-5c33-4ff3-a995-a43222f0dd5e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:42.068065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fa28a-5c33-4ff3-a995-a43222f0dd5e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:42.076629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bd960-e925-4f51-9150-3d03508a0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:42.078329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bd960-e925-4f51-9150-3d03508a0338 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:42.079057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bd960-e925-4f51-9150-3d03508a0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:42.079547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bd960-e925-4f51-9150-3d03508a0338 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:42.080891 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bd960-e925-4f51-9150-3d03508a0338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:42.084535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bd960-e925-4f51-9150-3d03508a0338 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:42.103058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1025/2034] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:42.105189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bef36-19c3-4ef8-b2e4-6f9d04a46997 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:42.115726 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bd960-e925-4f51-9150-3d03508a0338 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:42.117958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-fd7bd960-e925-4f51-9150-3d03508a0338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:42.124414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bef36-19c3-4ef8-b2e4-6f9d04a46997 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:42.132882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bd960-e925-4f51-9150-3d03508a0338 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:42.133099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48940b23-8bea-4715-9e40-9158085fc289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:42.134056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48940b23-8bea-4715-9e40-9158085fc289 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:42.134512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48940b23-8bea-4715-9e40-9158085fc289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:42.134988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48940b23-8bea-4715-9e40-9158085fc289 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:42.136357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48940b23-8bea-4715-9e40-9158085fc289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:42.138303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:42.139095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48940b23-8bea-4715-9e40-9158085fc289 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:42.139247 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:42.139420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:42.139678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] PATH_INFO: `/v3/users/3674eab1fb4a496685f62b81e286e8ed` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:42.140947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3674eab1fb4a496685f62b81e286e8ed)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:42.143251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:42.168811 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1010/2035] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:42.175158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48940b23-8bea-4715-9e40-9158085fc289 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:42.192885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48940b23-8bea-4715-9e40-9158085fc289 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:42.200942 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77390ba1-1d50-46f3-a11a-abfc43b1ffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:42.202579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77390ba1-1d50-46f3-a11a-abfc43b1ffe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:42.203073 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77390ba1-1d50-46f3-a11a-abfc43b1ffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:42.203503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77390ba1-1d50-46f3-a11a-abfc43b1ffe2 admin admin] PATH_INFO: `/v3/projects/fa4758fcb64146d79c8b504e89e6b5de/users/611a859cabe24698ae2db4274c3afd80/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:42.212659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3674eab1fb4a496685f62b81e286e8ed'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:42.225074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77390ba1-1d50-46f3-a11a-abfc43b1ffe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4758fcb64146d79c8b504e89e6b5de, user_id=611a859cabe24698ae2db4274c3afd80, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:42.225945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3674eab1fb4a496685f62b81e286e8ed'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:42.227335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3674eab1fb4a496685f62b81e286e8ed'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:42.228368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77390ba1-1d50-46f3-a11a-abfc43b1ffe2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:42.239043 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3674eab1fb4a496685f62b81e286e8ed'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:42.250269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1011/2036] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:42 2022] PUT /identity/v3/projects/fa4758fcb64146d79c8b504e89e6b5de/users/611a859cabe24698ae2db4274c3afd80/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:42.258455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839e33-dfd0-41e2-8058-224407dd2f83 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:42.258954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839e33-dfd0-41e2-8058-224407dd2f83 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:42.259319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-db196a63-cc9c-42d2-a8a8-9c5dc0a9e610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3674eab1fb4a496685f62b81e286e8ed'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:42.259489 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839e33-dfd0-41e2-8058-224407dd2f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:42.270025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1026/2037] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:42 2022] DELETE /identity/v3/users/3674eab1fb4a496685f62b81e286e8ed => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:42.276702 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ba67f-549c-42dd-b0cc-c47fa9dab8ee None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:42.277164 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ba67f-549c-42dd-b0cc-c47fa9dab8ee None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:42.277723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ba67f-549c-42dd-b0cc-c47fa9dab8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:42.289064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-47839e33-dfd0-41e2-8058-224407dd2f83 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:42.290943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-47839e33-dfd0-41e2-8058-224407dd2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:42.304452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b83ba67f-549c-42dd-b0cc-c47fa9dab8ee None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:42.306720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b83ba67f-549c-42dd-b0cc-c47fa9dab8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:42.371526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1012/2038] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:42.382462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839e33-dfd0-41e2-8058-224407dd2f83 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:42.384168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-47839e33-dfd0-41e2-8058-224407dd2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:42.407440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1027/2039] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:42.425065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ba67f-549c-42dd-b0cc-c47fa9dab8ee None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:42.426766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b83ba67f-549c-42dd-b0cc-c47fa9dab8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:42.455808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839e33-dfd0-41e2-8058-224407dd2f83 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:42.462007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d0bdb-544d-4103-a9db-b4e650ef5c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:42.462702 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0bdb-544d-4103-a9db-b4e650ef5c7d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:42.463000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0bdb-544d-4103-a9db-b4e650ef5c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:42.463273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d0bdb-544d-4103-a9db-b4e650ef5c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:42.473607 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d0bdb-544d-4103-a9db-b4e650ef5c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:42.475057 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d0bdb-544d-4103-a9db-b4e650ef5c7d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:42.486767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1013/2040] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:26:42.503653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ba67f-549c-42dd-b0cc-c47fa9dab8ee None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:42.509916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9c374-549f-4c9e-95f1-bef579705641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:42.510918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c374-549f-4c9e-95f1-bef579705641 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:42.511377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c374-549f-4c9e-95f1-bef579705641 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:42.511801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c374-549f-4c9e-95f1-bef579705641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:42.528564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9c374-549f-4c9e-95f1-bef579705641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:42.530180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9c374-549f-4c9e-95f1-bef579705641 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:42.541764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1028/2041] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:42.706962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db1356-3940-4d89-879d-2ef2ce11eb4d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:42.709217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db1356-3940-4d89-879d-2ef2ce11eb4d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:42.709832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db1356-3940-4d89-879d-2ef2ce11eb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:42.742013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e8db1356-3940-4d89-879d-2ef2ce11eb4d None None] MFA Rules not processed for user `bdd86efb97ad48a994f04304a8459e54`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:42.744219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e8db1356-3940-4d89-879d-2ef2ce11eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:42.840632 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1014/2042] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:43.452706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9c374-549f-4c9e-95f1-bef579705641 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:43.456644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0fe9c374-549f-4c9e-95f1-bef579705641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:43.492243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9c374-549f-4c9e-95f1-bef579705641 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:43.503931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:43.505905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:43.506748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:43.507516 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] PATH_INFO: `/v3/projects/eed5fde66fcd4dc58983eede9049d226` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:43.510597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed5fde66fcd4dc58983eede9049d226)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:43.515751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:43.523320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db1356-3940-4d89-879d-2ef2ce11eb4d None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:43.525518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e8db1356-3940-4d89-879d-2ef2ce11eb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:43.563811 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db1356-3940-4d89-879d-2ef2ce11eb4d None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:43.574837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:43.590710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:43.593375 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:43.594122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] PATH_INFO: `/v3/users/6d8e2514c53d42acb9ebd7695660bf61` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:43.598420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8e2514c53d42acb9ebd7695660bf61)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:43.602478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed5fde66fcd4dc58983eede9049d226', 'request_id': 'req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.605691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:43.616413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed5fde66fcd4dc58983eede9049d226', 'request_id': 'req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.636659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed5fde66fcd4dc58983eede9049d226', 'request_id': 'req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.663976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] The token cache is being invalidate because project eed5fde66fcd4dc58983eede9049d226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:43.665201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.666358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.673431 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1029/2043] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:43 2022] DELETE /identity/v3/projects/eed5fde66fcd4dc58983eede9049d226 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:43.679991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:43.683175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:43.749110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8e2514c53d42acb9ebd7695660bf61'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.762936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8e2514c53d42acb9ebd7695660bf61'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.769085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8f6f-e78d-42dc-a94c-85b16e6da9e4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:43.779122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8e2514c53d42acb9ebd7695660bf61'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.779901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:43.780434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8e2514c53d42acb9ebd7695660bf61'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.781104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:43.782913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:43.783431 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] PATH_INFO: `/v3/users/6d139d9a60384195aa8c19c6a5a812a5` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:43.786177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d139d9a60384195aa8c19c6a5a812a5)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:43.789766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:43.797844 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2ea6976f-50d1-42d8-9f8a-208bdc589ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8e2514c53d42acb9ebd7695660bf61'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.810877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1015/2044] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:43 2022] DELETE /identity/v3/users/6d8e2514c53d42acb9ebd7695660bf61 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:43.810877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcc796-b65d-441a-9d27-57e90c34d482 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:43.810877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcc796-b65d-441a-9d27-57e90c34d482 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:43.811379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcc796-b65d-441a-9d27-57e90c34d482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:43.874383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8ddcc796-b65d-441a-9d27-57e90c34d482 None None] MFA Rules not processed for user `611a859cabe24698ae2db4274c3afd80`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:43.876767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8ddcc796-b65d-441a-9d27-57e90c34d482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:43.889355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d139d9a60384195aa8c19c6a5a812a5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.897692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d139d9a60384195aa8c19c6a5a812a5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.898533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d139d9a60384195aa8c19c6a5a812a5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.911517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d139d9a60384195aa8c19c6a5a812a5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.942512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f029a074-00dd-4d39-ae65-e2b4319e7579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d139d9a60384195aa8c19c6a5a812a5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:43.957004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1030/2045] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:43 2022] DELETE /identity/v3/users/6d139d9a60384195aa8c19c6a5a812a5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:43.960741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bc8df-6faa-4ac8-8d98-719cbe92f7c0 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:43.960741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bc8df-6faa-4ac8-8d98-719cbe92f7c0 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:43.971299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bc8df-6faa-4ac8-8d98-719cbe92f7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:43.989885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1016/2046] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:43.996804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcc796-b65d-441a-9d27-57e90c34d482 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:44.002229 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8ddcc796-b65d-441a-9d27-57e90c34d482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:44.035306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-475bc8df-6faa-4ac8-8d98-719cbe92f7c0 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:44.038035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-475bc8df-6faa-4ac8-8d98-719cbe92f7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:44.114007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcc796-b65d-441a-9d27-57e90c34d482 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:44.181491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1031/2047] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:44.195310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea8203-c235-46bd-a107-7565d162b1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:44.196004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea8203-c235-46bd-a107-7565d162b1ea admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:44.196394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea8203-c235-46bd-a107-7565d162b1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:44.196814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea8203-c235-46bd-a107-7565d162b1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:44.198467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea8203-c235-46bd-a107-7565d162b1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:44.200219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bc8df-6faa-4ac8-8d98-719cbe92f7c0 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:44.200685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea8203-c235-46bd-a107-7565d162b1ea admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:44.202664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-475bc8df-6faa-4ac8-8d98-719cbe92f7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:44.251177 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1017/2048] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:43 2022] POST /identity/v3/projects => generated 405 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:44.253486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea8203-c235-46bd-a107-7565d162b1ea admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:44.327584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bc8df-6faa-4ac8-8d98-719cbe92f7c0 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:44.391109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea8203-c235-46bd-a107-7565d162b1ea admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:44.394658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce9122-b743-4f4a-add8-84d2d5918fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:44.395723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce9122-b743-4f4a-add8-84d2d5918fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:44.396223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce9122-b743-4f4a-add8-84d2d5918fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:44.396569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce9122-b743-4f4a-add8-84d2d5918fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:44.403286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d8fe-7ab3-4e2c-a6ec-cefcbe7a9da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:44.404709 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d8fe-7ab3-4e2c-a6ec-cefcbe7a9da4 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:44.405188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d8fe-7ab3-4e2c-a6ec-cefcbe7a9da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:44.405921 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d8fe-7ab3-4e2c-a6ec-cefcbe7a9da4 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:44.408856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d8fe-7ab3-4e2c-a6ec-cefcbe7a9da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:44.409112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce9122-b743-4f4a-add8-84d2d5918fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:44.411060 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce9122-b743-4f4a-add8-84d2d5918fd6 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:44.412415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d8fe-7ab3-4e2c-a6ec-cefcbe7a9da4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:44.425708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1032/2049] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:26:44.452784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1018/2050] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:44 2022] POST /identity/v3/users => generated 309 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:44.459154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce9122-b743-4f4a-add8-84d2d5918fd6 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:44.477084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce9122-b743-4f4a-add8-84d2d5918fd6 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:44.483713 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec33674-9e9f-4c3f-b3be-6e19fc82e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:44.484403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec33674-9e9f-4c3f-b3be-6e19fc82e457 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:44.484686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec33674-9e9f-4c3f-b3be-6e19fc82e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:44.485044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec33674-9e9f-4c3f-b3be-6e19fc82e457 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:44.485840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec33674-9e9f-4c3f-b3be-6e19fc82e457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:44.487641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec33674-9e9f-4c3f-b3be-6e19fc82e457 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:44.521839 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1033/2051] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:44.531184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d8fe-7ab3-4e2c-a6ec-cefcbe7a9da4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:44.546784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d8fe-7ab3-4e2c-a6ec-cefcbe7a9da4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:44.559075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c85996-aff8-424c-8654-3d6fc6dd048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:44.561136 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c85996-aff8-424c-8654-3d6fc6dd048b admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:44.562462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c85996-aff8-424c-8654-3d6fc6dd048b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:44.562462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c85996-aff8-424c-8654-3d6fc6dd048b admin admin] PATH_INFO: `/v3/projects/231a0f074ef44c338dd963f03531eb1d/users/e154dad60eca4648904dd928846b6fff/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:44.594746 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c85996-aff8-424c-8654-3d6fc6dd048b admin admin] RBAC: Authorizing `identity:create_grant(project_id=231a0f074ef44c338dd963f03531eb1d, user_id=e154dad60eca4648904dd928846b6fff, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:44.597882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c85996-aff8-424c-8654-3d6fc6dd048b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:44.637676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec33674-9e9f-4c3f-b3be-6e19fc82e457 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:44.638875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1019/2052] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:44 2022] PUT /identity/v3/projects/231a0f074ef44c338dd963f03531eb1d/users/e154dad60eca4648904dd928846b6fff/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:44.658216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec33674-9e9f-4c3f-b3be-6e19fc82e457 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:44.708650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c85996-aff8-424c-8654-3d6fc6dd048b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:44.711529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d6c85996-aff8-424c-8654-3d6fc6dd048b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:44.784318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbbd41-1ebf-4b9a-80dc-9a55abafe13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:44.785485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbbd41-1ebf-4b9a-80dc-9a55abafe13b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:44.786312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbbd41-1ebf-4b9a-80dc-9a55abafe13b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:44.786794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbbd41-1ebf-4b9a-80dc-9a55abafe13b admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:44.787996 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbbd41-1ebf-4b9a-80dc-9a55abafe13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:44.790881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbbd41-1ebf-4b9a-80dc-9a55abafe13b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:44.813577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1034/2053] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:44.815590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbbd41-1ebf-4b9a-80dc-9a55abafe13b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:44.832964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbbd41-1ebf-4b9a-80dc-9a55abafe13b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:44.840511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49d013-05c0-48af-b783-05484a783c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:44.841560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d013-05c0-48af-b783-05484a783c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:44.843084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d013-05c0-48af-b783-05484a783c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:44.843446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d013-05c0-48af-b783-05484a783c79 admin admin] PATH_INFO: `/v3/projects/231a0f074ef44c338dd963f03531eb1d/users/e154dad60eca4648904dd928846b6fff/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:44.845316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c85996-aff8-424c-8654-3d6fc6dd048b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:44.849182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49d013-05c0-48af-b783-05484a783c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231a0f074ef44c338dd963f03531eb1d, user_id=e154dad60eca4648904dd928846b6fff, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:44.854906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:44.857089 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:44.857715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:44.858024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49d013-05c0-48af-b783-05484a783c79 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:44.858407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] PATH_INFO: `/v3/projects/b0e8a6abb9a540878011f36babe3ec2e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:44.860253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e8a6abb9a540878011f36babe3ec2e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:44.863087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:44.904183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1035/2054] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:44 2022] PUT /identity/v3/projects/231a0f074ef44c338dd963f03531eb1d/users/e154dad60eca4648904dd928846b6fff/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:44.997889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e8a6abb9a540878011f36babe3ec2e', 'request_id': 'req-db5d669c-7f3b-4a09-87fb-4465b2526b27'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.026978 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e8a6abb9a540878011f36babe3ec2e', 'request_id': 'req-db5d669c-7f3b-4a09-87fb-4465b2526b27'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.047167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e8a6abb9a540878011f36babe3ec2e', 'request_id': 'req-db5d669c-7f3b-4a09-87fb-4465b2526b27'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.071158 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] The token cache is being invalidate because project b0e8a6abb9a540878011f36babe3ec2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:45.071666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.072798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-db5d669c-7f3b-4a09-87fb-4465b2526b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.076105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1020/2055] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:44 2022] DELETE /identity/v3/projects/b0e8a6abb9a540878011f36babe3ec2e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:45.085755 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4483-1e9d-4552-938e-b11063eaf18e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:45.086614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4483-1e9d-4552-938e-b11063eaf18e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:45.087306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f4483-1e9d-4552-938e-b11063eaf18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:45.119659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-dc4f4483-1e9d-4552-938e-b11063eaf18e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:45.121903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-dc4f4483-1e9d-4552-938e-b11063eaf18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:45.228378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1036/2056] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:45.241919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d712-3139-4777-8dd0-0cc46cb941af None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:45.242431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d712-3139-4777-8dd0-0cc46cb941af None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:45.242917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7d712-3139-4777-8dd0-0cc46cb941af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:45.279835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-64b7d712-3139-4777-8dd0-0cc46cb941af None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:45.281864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-64b7d712-3139-4777-8dd0-0cc46cb941af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:45.293760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1021/2057] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:45.301275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f4483-1e9d-4552-938e-b11063eaf18e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:45.302138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d712-3139-4777-8dd0-0cc46cb941af None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:45.308889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-64b7d712-3139-4777-8dd0-0cc46cb941af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:45.318285 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f4483-1e9d-4552-938e-b11063eaf18e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:45.325553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffea8-a08d-4066-aa25-e335a0210669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:45.326704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffea8-a08d-4066-aa25-e335a0210669 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:45.327180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffea8-a08d-4066-aa25-e335a0210669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:45.328011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffea8-a08d-4066-aa25-e335a0210669 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:45.328983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ffea8-a08d-4066-aa25-e335a0210669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:45.329556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ffea8-a08d-4066-aa25-e335a0210669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:45.333143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ffea8-a08d-4066-aa25-e335a0210669 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:45.346205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7d712-3139-4777-8dd0-0cc46cb941af None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:45.361937 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:45.364211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1037/2058] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:45.364647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:45.365418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:45.366073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffea8-a08d-4066-aa25-e335a0210669 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:45.367626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] PATH_INFO: `/v3/projects/561a159da877463da86541b07e292991` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:45.370179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561a159da877463da86541b07e292991)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:45.374332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:45.384523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffea8-a08d-4066-aa25-e335a0210669 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:45.389898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c43e8d-6770-41b3-bf4b-444c2e7104b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:45.390590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c43e8d-6770-41b3-bf4b-444c2e7104b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:45.390927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c43e8d-6770-41b3-bf4b-444c2e7104b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:45.391156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c43e8d-6770-41b3-bf4b-444c2e7104b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:45.391929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c43e8d-6770-41b3-bf4b-444c2e7104b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:45.394055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c43e8d-6770-41b3-bf4b-444c2e7104b8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:45.470072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1038/2059] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:45 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:45.476429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c43e8d-6770-41b3-bf4b-444c2e7104b8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:45.493608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561a159da877463da86541b07e292991', 'request_id': 'req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.510017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561a159da877463da86541b07e292991', 'request_id': 'req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.526118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561a159da877463da86541b07e292991', 'request_id': 'req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.546737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] The token cache is being invalidate because project 561a159da877463da86541b07e292991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:45.547402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.548173 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.554145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1022/2060] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:45 2022] DELETE /identity/v3/projects/561a159da877463da86541b07e292991 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:45.560783 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:45.565051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:45.663139 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c43e8d-6770-41b3-bf4b-444c2e7104b8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:45.681617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b6a56-9193-420f-8e76-35d89775f954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:45.681617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b6a56-9193-420f-8e76-35d89775f954 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:45.681617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b6a56-9193-420f-8e76-35d89775f954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:45.681617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b6a56-9193-420f-8e76-35d89775f954 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:45.682099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b6a56-9193-420f-8e76-35d89775f954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:45.682099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b6a56-9193-420f-8e76-35d89775f954 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:45.686961 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cccbcf-84cb-4c03-a2e5-403e6134d2e4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:45.692632 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:45.693917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:45.694343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:45.694977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] PATH_INFO: `/v3/users/4d12986de55a4706b571ca732df751f5` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:45.697400 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d12986de55a4706b571ca732df751f5)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:45.701759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:45.712445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1039/2061] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:45 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:45.718760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b6a56-9193-420f-8e76-35d89775f954 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:45.721559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-159b6a56-9193-420f-8e76-35d89775f954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:45.744020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b6a56-9193-420f-8e76-35d89775f954 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:45.754568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61885067-3243-4aa2-b9f5-806f1dd4c896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:45.756085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885067-3243-4aa2-b9f5-806f1dd4c896 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:45.756255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885067-3243-4aa2-b9f5-806f1dd4c896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:45.756766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61885067-3243-4aa2-b9f5-806f1dd4c896 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:45.758469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61885067-3243-4aa2-b9f5-806f1dd4c896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:45.762193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61885067-3243-4aa2-b9f5-806f1dd4c896 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:45.787519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1040/2062] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:45.793172 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61885067-3243-4aa2-b9f5-806f1dd4c896 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:45.793914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d12986de55a4706b571ca732df751f5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.808351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d12986de55a4706b571ca732df751f5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.815554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61885067-3243-4aa2-b9f5-806f1dd4c896 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:45.823103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2496f4-a2fa-4e70-b104-b866e2a9d643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:45.824195 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2496f4-a2fa-4e70-b104-b866e2a9d643 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:45.824637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2496f4-a2fa-4e70-b104-b866e2a9d643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:45.825112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2496f4-a2fa-4e70-b104-b866e2a9d643 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:45.826529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2496f4-a2fa-4e70-b104-b866e2a9d643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:45.829827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2496f4-a2fa-4e70-b104-b866e2a9d643 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:45.835549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d12986de55a4706b571ca732df751f5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.837036 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d12986de55a4706b571ca732df751f5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.850413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1041/2063] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:45.852352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-021af982-6357-4fdb-b054-9a5f2a4c7eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d12986de55a4706b571ca732df751f5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:45.856088 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2496f4-a2fa-4e70-b104-b866e2a9d643 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:45.859236 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-cd2496f4-a2fa-4e70-b104-b866e2a9d643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:45.864914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1023/2064] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:45 2022] DELETE /identity/v3/users/4d12986de55a4706b571ca732df751f5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:45.882061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2496f4-a2fa-4e70-b104-b866e2a9d643 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:45.998155 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da916424-f131-456d-97ab-020a290dbc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:45.999472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da916424-f131-456d-97ab-020a290dbc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:45.999898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da916424-f131-456d-97ab-020a290dbc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:46.000220 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da916424-f131-456d-97ab-020a290dbc7a admin admin] PATH_INFO: `/v3/projects/993bbafbaa7d4848a6e9593c71e71857/users/830c2ebd15d24d3ebef3069af34d09ae/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:46.027347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da916424-f131-456d-97ab-020a290dbc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=993bbafbaa7d4848a6e9593c71e71857, user_id=830c2ebd15d24d3ebef3069af34d09ae, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:46.030606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da916424-f131-456d-97ab-020a290dbc7a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:46.065597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1042/2065] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:45 2022] PUT /identity/v3/projects/993bbafbaa7d4848a6e9593c71e71857/users/830c2ebd15d24d3ebef3069af34d09ae/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:46.081498 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4921a4e-4bcd-446d-b6d7-bc2e2def8cd7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:46.083030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4921a4e-4bcd-446d-b6d7-bc2e2def8cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:46.083655 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4921a4e-4bcd-446d-b6d7-bc2e2def8cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:46.187406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c4921a4e-4bcd-446d-b6d7-bc2e2def8cd7 None None] MFA Rules not processed for user `830c2ebd15d24d3ebef3069af34d09ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:46.188878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c4921a4e-4bcd-446d-b6d7-bc2e2def8cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:46.275223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48023d6e-7b48-41f6-8c56-d06eaf0ea016 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:46.276016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48023d6e-7b48-41f6-8c56-d06eaf0ea016 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:46.276522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48023d6e-7b48-41f6-8c56-d06eaf0ea016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:46.344328 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-48023d6e-7b48-41f6-8c56-d06eaf0ea016 None None] MFA Rules not processed for user `e154dad60eca4648904dd928846b6fff`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:46.348423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-48023d6e-7b48-41f6-8c56-d06eaf0ea016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:46.350453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1024/2066] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:46.355144 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4921a4e-4bcd-446d-b6d7-bc2e2def8cd7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:46.541057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1043/2067] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:46.576641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4921a4e-4bcd-446d-b6d7-bc2e2def8cd7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:46.587796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff37bfa-801b-4d26-aa4e-bdb919b29ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:46.589166 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff37bfa-801b-4d26-aa4e-bdb919b29ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:46.589706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff37bfa-801b-4d26-aa4e-bdb919b29ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:46.591333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff37bfa-801b-4d26-aa4e-bdb919b29ad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:46.592417 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff37bfa-801b-4d26-aa4e-bdb919b29ad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:46.599619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff37bfa-801b-4d26-aa4e-bdb919b29ad3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:46.729356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1025/2068] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:46 2022] POST /identity/v3/projects => generated 383 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:46.731011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48023d6e-7b48-41f6-8c56-d06eaf0ea016 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:46.764727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48023d6e-7b48-41f6-8c56-d06eaf0ea016 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:46.795241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff37bfa-801b-4d26-aa4e-bdb919b29ad3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:46.799259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bff37bfa-801b-4d26-aa4e-bdb919b29ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:46.984214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247c99-78f5-4854-ac5b-cfa861adf6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:46.985373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247c99-78f5-4854-ac5b-cfa861adf6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:46.985864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247c99-78f5-4854-ac5b-cfa861adf6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:46.987107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247c99-78f5-4854-ac5b-cfa861adf6a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:46.988672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6247c99-78f5-4854-ac5b-cfa861adf6a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:46.993324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff37bfa-801b-4d26-aa4e-bdb919b29ad3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:46.997617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6247c99-78f5-4854-ac5b-cfa861adf6a4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:47.002182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:47.003643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.004375 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.005051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] PATH_INFO: `/v3/projects/a74f9db07bd04527b1e0080a65dc1aaa` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.008291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74f9db07bd04527b1e0080a65dc1aaa)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:47.011889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:47.058726 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1044/2069] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:46 2022] POST /identity/v3/users => generated 298 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:47.064286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247c99-78f5-4854-ac5b-cfa861adf6a4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:47.084965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247c99-78f5-4854-ac5b-cfa861adf6a4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:47.095013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677122-da92-485a-8857-5e21d26f9da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:47.096868 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677122-da92-485a-8857-5e21d26f9da6 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.097378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677122-da92-485a-8857-5e21d26f9da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.097798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677122-da92-485a-8857-5e21d26f9da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.098664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f677122-da92-485a-8857-5e21d26f9da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:47.100663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f677122-da92-485a-8857-5e21d26f9da6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:47.113739 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1045/2070] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:47.121030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677122-da92-485a-8857-5e21d26f9da6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:47.131433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74f9db07bd04527b1e0080a65dc1aaa', 'request_id': 'req-394b2291-f4c3-4cc5-962a-9e317b1c02ab'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:47.139947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677122-da92-485a-8857-5e21d26f9da6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:47.141933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74f9db07bd04527b1e0080a65dc1aaa', 'request_id': 'req-394b2291-f4c3-4cc5-962a-9e317b1c02ab'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:47.156975 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74f9db07bd04527b1e0080a65dc1aaa', 'request_id': 'req-394b2291-f4c3-4cc5-962a-9e317b1c02ab'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:47.188226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] The token cache is being invalidate because project a74f9db07bd04527b1e0080a65dc1aaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:47.188529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:47.189313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-394b2291-f4c3-4cc5-962a-9e317b1c02ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:47.195770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1026/2071] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:46 2022] DELETE /identity/v3/projects/a74f9db07bd04527b1e0080a65dc1aaa => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:47.197813 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93d9ac-18ab-4a4f-b4fe-ee8feaa87c1b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.198374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93d9ac-18ab-4a4f-b4fe-ee8feaa87c1b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.198849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93d9ac-18ab-4a4f-b4fe-ee8feaa87c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.236739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7f93d9ac-18ab-4a4f-b4fe-ee8feaa87c1b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:47.239508 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7f93d9ac-18ab-4a4f-b4fe-ee8feaa87c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:47.246759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a19db-fbb9-42e3-bdd0-c66384cda4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:47.246759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a19db-fbb9-42e3-bdd0-c66384cda4d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.247138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a19db-fbb9-42e3-bdd0-c66384cda4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.249034 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a19db-fbb9-42e3-bdd0-c66384cda4d2 admin admin] PATH_INFO: `/v3/projects/802d11609ce145449b685ec0ac0c51b3/users/108684f4a2bd46ada744d6daf4a1442c/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.261299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1027/2072] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:47.270272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a19db-fbb9-42e3-bdd0-c66384cda4d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802d11609ce145449b685ec0ac0c51b3, user_id=108684f4a2bd46ada744d6daf4a1442c, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:47.270578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601de4-97d7-46e5-b002-4b74783e728a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.270744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601de4-97d7-46e5-b002-4b74783e728a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.270923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601de4-97d7-46e5-b002-4b74783e728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.278297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a19db-fbb9-42e3-bdd0-c66384cda4d2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:47.298727 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-13601de4-97d7-46e5-b002-4b74783e728a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:47.301203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-13601de4-97d7-46e5-b002-4b74783e728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:47.310747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1046/2073] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:47 2022] PUT /identity/v3/projects/802d11609ce145449b685ec0ac0c51b3/users/108684f4a2bd46ada744d6daf4a1442c/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:47.314803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a19db-fbb9-42e3-bdd0-c66384cda4d2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:47.316820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-cf7a19db-fbb9-42e3-bdd0-c66384cda4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:47.421635 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a19db-fbb9-42e3-bdd0-c66384cda4d2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:47.427555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21021e7d-16c8-4fcb-9a78-adfedbb90c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:47.430927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21021e7d-16c8-4fcb-9a78-adfedbb90c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.430927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21021e7d-16c8-4fcb-9a78-adfedbb90c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.431194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1028/2074] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:47.433536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21021e7d-16c8-4fcb-9a78-adfedbb90c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.434390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21021e7d-16c8-4fcb-9a78-adfedbb90c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:47.436050 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13601de4-97d7-46e5-b002-4b74783e728a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:47.436208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21021e7d-16c8-4fcb-9a78-adfedbb90c2f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:47.470995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1047/2075] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:47.473528 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21021e7d-16c8-4fcb-9a78-adfedbb90c2f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:47.473842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13601de4-97d7-46e5-b002-4b74783e728a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:47.490565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b09ca0-888e-4057-a766-040e7b90839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:47.491941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b09ca0-888e-4057-a766-040e7b90839c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.492977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b09ca0-888e-4057-a766-040e7b90839c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.492977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b09ca0-888e-4057-a766-040e7b90839c admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.494286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b09ca0-888e-4057-a766-040e7b90839c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:47.495031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b09ca0-888e-4057-a766-040e7b90839c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:47.503832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b09ca0-888e-4057-a766-040e7b90839c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:47.504657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21021e7d-16c8-4fcb-9a78-adfedbb90c2f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:47.514562 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dc026-437c-4171-b3d4-d8d14c5cd607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:47.516128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dc026-437c-4171-b3d4-d8d14c5cd607 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.516599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dc026-437c-4171-b3d4-d8d14c5cd607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.517057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dc026-437c-4171-b3d4-d8d14c5cd607 admin admin] PATH_INFO: `/v3/projects/802d11609ce145449b685ec0ac0c51b3/users/108684f4a2bd46ada744d6daf4a1442c/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.523513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dc026-437c-4171-b3d4-d8d14c5cd607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802d11609ce145449b685ec0ac0c51b3, user_id=108684f4a2bd46ada744d6daf4a1442c, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:47.530413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dc026-437c-4171-b3d4-d8d14c5cd607 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:47.542886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1029/2076] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:47.549178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b09ca0-888e-4057-a766-040e7b90839c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:47.555746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1048/2077] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:47 2022] PUT /identity/v3/projects/802d11609ce145449b685ec0ac0c51b3/users/108684f4a2bd46ada744d6daf4a1442c/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:47.569895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b09ca0-888e-4057-a766-040e7b90839c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:47.579301 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0a31f-0229-4c14-9fdf-43e928de1162 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.580929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0a31f-0229-4c14-9fdf-43e928de1162 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.581358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0a31f-0229-4c14-9fdf-43e928de1162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.627612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-7aa0a31f-0229-4c14-9fdf-43e928de1162 None None] MFA Rules not processed for user `108684f4a2bd46ada744d6daf4a1442c`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:47.630719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7aa0a31f-0229-4c14-9fdf-43e928de1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:47.647148 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834b725-b7b7-4e46-b0bc-e9aa22b49603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:47.647722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834b725-b7b7-4e46-b0bc-e9aa22b49603 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.647993 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834b725-b7b7-4e46-b0bc-e9aa22b49603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.648265 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834b725-b7b7-4e46-b0bc-e9aa22b49603 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.648978 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834b725-b7b7-4e46-b0bc-e9aa22b49603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:47.651666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834b725-b7b7-4e46-b0bc-e9aa22b49603 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:47.696050 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1030/2078] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:47 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:47.702007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834b725-b7b7-4e46-b0bc-e9aa22b49603 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:47.766721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1049/2079] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:47.780736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0a31f-0229-4c14-9fdf-43e928de1162 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:47.783372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7aa0a31f-0229-4c14-9fdf-43e928de1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:47.864770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834b725-b7b7-4e46-b0bc-e9aa22b49603 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:47.873834 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937f6e-815f-488d-b2e8-38c187a8135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:47.875121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937f6e-815f-488d-b2e8-38c187a8135d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.876246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937f6e-815f-488d-b2e8-38c187a8135d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.887450 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937f6e-815f-488d-b2e8-38c187a8135d admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.889256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937f6e-815f-488d-b2e8-38c187a8135d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:47.894005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937f6e-815f-488d-b2e8-38c187a8135d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:47.897009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0a31f-0229-4c14-9fdf-43e928de1162 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:47.937882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1031/2080] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:47 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:47.946438 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937f6e-815f-488d-b2e8-38c187a8135d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:47.963358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937f6e-815f-488d-b2e8-38c187a8135d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:47.986564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ce705-c6e5-4233-97cf-266a193aa179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:47.989284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ce705-c6e5-4233-97cf-266a193aa179 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:47.989879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ce705-c6e5-4233-97cf-266a193aa179 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:47.990242 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ce705-c6e5-4233-97cf-266a193aa179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:47.998116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e83fa-2abb-401b-9f1d-4b1727082199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:48.004299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e83fa-2abb-401b-9f1d-4b1727082199 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:48.006051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e83fa-2abb-401b-9f1d-4b1727082199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:48.006782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e83fa-2abb-401b-9f1d-4b1727082199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:48.012270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e83fa-2abb-401b-9f1d-4b1727082199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:48.018351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e83fa-2abb-401b-9f1d-4b1727082199 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:48.074464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1032/2081] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:48.079798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e83fa-2abb-401b-9f1d-4b1727082199 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:48.106829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e83fa-2abb-401b-9f1d-4b1727082199 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:48.121781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed17908-a323-4037-b80e-d594dbd318ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:48.124301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed17908-a323-4037-b80e-d594dbd318ac admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:48.125451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed17908-a323-4037-b80e-d594dbd318ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:48.126119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed17908-a323-4037-b80e-d594dbd318ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:48.127640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed17908-a323-4037-b80e-d594dbd318ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:48.131484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed17908-a323-4037-b80e-d594dbd318ac admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:48.148516 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ce705-c6e5-4233-97cf-266a193aa179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:48.150169 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ce705-c6e5-4233-97cf-266a193aa179 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:48.155122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1033/2082] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:48.159739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed17908-a323-4037-b80e-d594dbd318ac admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:48.173615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1050/2083] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:48.187540 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed17908-a323-4037-b80e-d594dbd318ac admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:48.205525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f040-104f-4d63-8039-fcf30016e06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:48.206446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f040-104f-4d63-8039-fcf30016e06d admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:48.206725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f040-104f-4d63-8039-fcf30016e06d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:48.206995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f040-104f-4d63-8039-fcf30016e06d admin admin] PATH_INFO: `/v3/projects/eb533a169f4f438c8fd15efb76bc79c1/users/f97e2ddfde6c4445ade2b1d56629d5a3/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:48.243224 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3f040-104f-4d63-8039-fcf30016e06d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb533a169f4f438c8fd15efb76bc79c1, user_id=f97e2ddfde6c4445ade2b1d56629d5a3, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:48.248354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3f040-104f-4d63-8039-fcf30016e06d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:48.281530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1034/2084] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:48 2022] PUT /identity/v3/projects/eb533a169f4f438c8fd15efb76bc79c1/users/f97e2ddfde6c4445ade2b1d56629d5a3/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:48.292906 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf4ca-0628-4ea7-bdca-da6c9d9cbc84 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:48.293448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf4ca-0628-4ea7-bdca-da6c9d9cbc84 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:48.293928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf4ca-0628-4ea7-bdca-da6c9d9cbc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:48.334877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f040-104f-4d63-8039-fcf30016e06d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:48.357302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-398cf4ca-0628-4ea7-bdca-da6c9d9cbc84 None None] MFA Rules not processed for user `f97e2ddfde6c4445ade2b1d56629d5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:48.359921 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-398cf4ca-0628-4ea7-bdca-da6c9d9cbc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:48.429880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f040-104f-4d63-8039-fcf30016e06d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:48.434085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad70436-f5a7-426d-bd73-e72bc7d93242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:48.434997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad70436-f5a7-426d-bd73-e72bc7d93242 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:48.435416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad70436-f5a7-426d-bd73-e72bc7d93242 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:48.435825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad70436-f5a7-426d-bd73-e72bc7d93242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:48.439273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5ad70436-f5a7-426d-bd73-e72bc7d93242 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:48.453650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1051/2085] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:48.458472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cf4ca-0628-4ea7-bdca-da6c9d9cbc84 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:48.536926 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cf4ca-0628-4ea7-bdca-da6c9d9cbc84 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:48.542116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08713cd6-3cc3-4305-abd8-69b3c181d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:48.542790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08713cd6-3cc3-4305-abd8-69b3c181d13c admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:48.543137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08713cd6-3cc3-4305-abd8-69b3c181d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:48.543415 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08713cd6-3cc3-4305-abd8-69b3c181d13c admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:48.544773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad70436-f5a7-426d-bd73-e72bc7d93242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:48.544945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08713cd6-3cc3-4305-abd8-69b3c181d13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:48.547451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad70436-f5a7-426d-bd73-e72bc7d93242 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:48.547608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08713cd6-3cc3-4305-abd8-69b3c181d13c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:48.567311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1035/2086] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:26:48.599238 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad70436-f5a7-426d-bd73-e72bc7d93242 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:48.601817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-5ad70436-f5a7-426d-bd73-e72bc7d93242 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:48.647666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1052/2087] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:48 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:48.651101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad70436-f5a7-426d-bd73-e72bc7d93242 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:48.651680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08713cd6-3cc3-4305-abd8-69b3c181d13c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:48.771533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:48.771699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08713cd6-3cc3-4305-abd8-69b3c181d13c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:48.773061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:48.773635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:48.773979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] PATH_INFO: `/v3/users/611a859cabe24698ae2db4274c3afd80` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:48.775349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611a859cabe24698ae2db4274c3afd80)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:48.777549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:48.781728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b701d33-c643-4447-93f3-75896a93ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:48.784112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b701d33-c643-4447-93f3-75896a93ffd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:48.784664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b701d33-c643-4447-93f3-75896a93ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:48.785156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b701d33-c643-4447-93f3-75896a93ffd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:48.786720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b701d33-c643-4447-93f3-75896a93ffd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:48.792308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b701d33-c643-4447-93f3-75896a93ffd0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:48.845907 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1053/2088] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:48 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:48.857290 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b701d33-c643-4447-93f3-75896a93ffd0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:48.876931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b701d33-c643-4447-93f3-75896a93ffd0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:48.881413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f710d4-0372-4ae3-a973-a00cf12fa921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:48.882101 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f710d4-0372-4ae3-a973-a00cf12fa921 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:48.882736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f710d4-0372-4ae3-a973-a00cf12fa921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:48.882843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f710d4-0372-4ae3-a973-a00cf12fa921 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:48.883717 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f710d4-0372-4ae3-a973-a00cf12fa921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:48.885875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f710d4-0372-4ae3-a973-a00cf12fa921 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:48.894988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611a859cabe24698ae2db4274c3afd80'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:48.914711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611a859cabe24698ae2db4274c3afd80'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:48.928156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1054/2089] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:48.929584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f710d4-0372-4ae3-a973-a00cf12fa921 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:48.943491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611a859cabe24698ae2db4274c3afd80'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:48.946322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f710d4-0372-4ae3-a973-a00cf12fa921 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:48.949878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611a859cabe24698ae2db4274c3afd80'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:48.960950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f27e9-e616-4d0d-94dd-4433e8294a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:48.962176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f27e9-e616-4d0d-94dd-4433e8294a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:48.962607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f27e9-e616-4d0d-94dd-4433e8294a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:48.963017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f27e9-e616-4d0d-94dd-4433e8294a83 admin admin] PATH_INFO: `/v3/projects/ee283e3419bd41fabf56dd77351bf8c1/users/771edde4cad84fc5ad8db3ed7e63fdd3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:48.981659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611a859cabe24698ae2db4274c3afd80'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:48.991125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1036/2090] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:48 2022] DELETE /identity/v3/users/611a859cabe24698ae2db4274c3afd80 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:49.004135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f27e9-e616-4d0d-94dd-4433e8294a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee283e3419bd41fabf56dd77351bf8c1, user_id=771edde4cad84fc5ad8db3ed7e63fdd3, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:49.008382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f27e9-e616-4d0d-94dd-4433e8294a83 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:49.058160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1055/2091] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:48 2022] PUT /identity/v3/projects/ee283e3419bd41fabf56dd77351bf8c1/users/771edde4cad84fc5ad8db3ed7e63fdd3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:49.064881 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:49.067419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:49.268111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f27e9-e616-4d0d-94dd-4433e8294a83 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:49.270104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-249f27e9-e616-4d0d-94dd-4433e8294a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:49.271624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e05df-6c01-416c-bfaf-50cdcc93cdc2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:49.427328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbe075-209d-402d-baa5-62ac7c5fe522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:49.429004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe075-209d-402d-baa5-62ac7c5fe522 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:49.431838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe075-209d-402d-baa5-62ac7c5fe522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:49.432697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbe075-209d-402d-baa5-62ac7c5fe522 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:49.434558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbe075-209d-402d-baa5-62ac7c5fe522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:49.443142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbe075-209d-402d-baa5-62ac7c5fe522 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:49.478673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f27e9-e616-4d0d-94dd-4433e8294a83 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:49.488196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1037/2092] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:49.488196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbe075-209d-402d-baa5-62ac7c5fe522 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:49.493117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:49.494245 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a0cbe075-209d-402d-baa5-62ac7c5fe522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:49.495043 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:49.495543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:49.496035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] PATH_INFO: `/v3/users/830c2ebd15d24d3ebef3069af34d09ae` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:49.498579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=830c2ebd15d24d3ebef3069af34d09ae)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:49.502462 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:49.527514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbe075-209d-402d-baa5-62ac7c5fe522 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:49.540022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:49.541357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:49.541896 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:49.542394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] PATH_INFO: `/v3/projects/fa4758fcb64146d79c8b504e89e6b5de` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:49.544575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4758fcb64146d79c8b504e89e6b5de)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:49.560765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:49.651036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830c2ebd15d24d3ebef3069af34d09ae'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:49.659001 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4758fcb64146d79c8b504e89e6b5de', 'request_id': 'req-29b914db-44fc-41a3-b157-4b4b8c86ba79'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:49.674914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4758fcb64146d79c8b504e89e6b5de', 'request_id': 'req-29b914db-44fc-41a3-b157-4b4b8c86ba79'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:49.675529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830c2ebd15d24d3ebef3069af34d09ae'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:49.676594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830c2ebd15d24d3ebef3069af34d09ae'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:49.685437 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4758fcb64146d79c8b504e89e6b5de', 'request_id': 'req-29b914db-44fc-41a3-b157-4b4b8c86ba79'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:49.696258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830c2ebd15d24d3ebef3069af34d09ae'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:49.703055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] The token cache is being invalidate because project fa4758fcb64146d79c8b504e89e6b5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:49.703642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:49.704932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:49.708584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1038/2093] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:49 2022] DELETE /identity/v3/projects/fa4758fcb64146d79c8b504e89e6b5de => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:49.712718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:49.714633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:49.732680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830c2ebd15d24d3ebef3069af34d09ae'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:49.749716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1056/2094] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:49 2022] DELETE /identity/v3/users/830c2ebd15d24d3ebef3069af34d09ae => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:49.751449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:49.753956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:49.853324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b914db-44fc-41a3-b157-4b4b8c86ba79 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:49.898973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bf06b-7fe2-4a43-bfab-b4b9bce5c80d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:49.911383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:49.914473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:49.916048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:49.916048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] PATH_INFO: `/v3/users/e154dad60eca4648904dd928846b6fff` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:49.920394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e154dad60eca4648904dd928846b6fff)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:49.925148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:49.966539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88514ce-1790-4027-8fa2-6ce118381ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:49.968249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88514ce-1790-4027-8fa2-6ce118381ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:49.968739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88514ce-1790-4027-8fa2-6ce118381ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:49.969183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88514ce-1790-4027-8fa2-6ce118381ef2 admin admin] PATH_INFO: `/v3/projects/ee283e3419bd41fabf56dd77351bf8c1/users/771edde4cad84fc5ad8db3ed7e63fdd3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:49.976024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88514ce-1790-4027-8fa2-6ce118381ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee283e3419bd41fabf56dd77351bf8c1, user_id=771edde4cad84fc5ad8db3ed7e63fdd3, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:49.981840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88514ce-1790-4027-8fa2-6ce118381ef2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:50.009313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1039/2095] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:49 2022] PUT /identity/v3/projects/ee283e3419bd41fabf56dd77351bf8c1/users/771edde4cad84fc5ad8db3ed7e63fdd3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:50.011613 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2dc1d-d3e9-47f1-a934-51288b0ffdce None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:50.012190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2dc1d-d3e9-47f1-a934-51288b0ffdce None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:50.012471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2dc1d-d3e9-47f1-a934-51288b0ffdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:50.052093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e154dad60eca4648904dd928846b6fff'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:50.056812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-96f2dc1d-d3e9-47f1-a934-51288b0ffdce None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:50.059240 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-96f2dc1d-d3e9-47f1-a934-51288b0ffdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:50.067358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e154dad60eca4648904dd928846b6fff'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:50.069987 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e154dad60eca4648904dd928846b6fff'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:50.081579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e154dad60eca4648904dd928846b6fff'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:50.106827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8dbdceef-44f6-421c-b80c-80c70cafbdc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e154dad60eca4648904dd928846b6fff'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:50.115403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1057/2096] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:49 2022] DELETE /identity/v3/users/e154dad60eca4648904dd928846b6fff => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:50.117105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd18f-c3f0-475f-8bbd-bf3e96de69f2 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:50.118353 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd18f-c3f0-475f-8bbd-bf3e96de69f2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:50.118652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd18f-c3f0-475f-8bbd-bf3e96de69f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:50.188434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e50cd18f-c3f0-475f-8bbd-bf3e96de69f2 None None] MFA Rules not processed for user `771edde4cad84fc5ad8db3ed7e63fdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:50.190053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e50cd18f-c3f0-475f-8bbd-bf3e96de69f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:50.211991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1040/2097] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:50.235677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2dc1d-d3e9-47f1-a934-51288b0ffdce None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:50.237824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-96f2dc1d-d3e9-47f1-a934-51288b0ffdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:50.357054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1058/2098] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:50.378853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2dc1d-d3e9-47f1-a934-51288b0ffdce None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:50.379662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cd18f-c3f0-475f-8bbd-bf3e96de69f2 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:50.383002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e50cd18f-c3f0-475f-8bbd-bf3e96de69f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:50.492505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe2ae3-2431-4629-9f35-9afe5f0f53a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:50.493602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe2ae3-2431-4629-9f35-9afe5f0f53a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:50.493988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe2ae3-2431-4629-9f35-9afe5f0f53a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:50.494511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe2ae3-2431-4629-9f35-9afe5f0f53a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:50.532064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cd18f-c3f0-475f-8bbd-bf3e96de69f2 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:50.541767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c178ad-9ed7-4d50-9fee-9db9314269ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:50.543998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c178ad-9ed7-4d50-9fee-9db9314269ed service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:50.544681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c178ad-9ed7-4d50-9fee-9db9314269ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:50.546140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c178ad-9ed7-4d50-9fee-9db9314269ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:50.565773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c178ad-9ed7-4d50-9fee-9db9314269ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:50.568018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c178ad-9ed7-4d50-9fee-9db9314269ed service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:50.587727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1059/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:26:50.589257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c178ad-9ed7-4d50-9fee-9db9314269ed service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:50.591606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-54c178ad-9ed7-4d50-9fee-9db9314269ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:50.618280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe2ae3-2431-4629-9f35-9afe5f0f53a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:50.621099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe2ae3-2431-4629-9f35-9afe5f0f53a7 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:50.639654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1041/2100] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:50.705409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c178ad-9ed7-4d50-9fee-9db9314269ed service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:50.720723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:50.721664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:50.723290 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:50.723673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] PATH_INFO: `/v3/projects/231a0f074ef44c338dd963f03531eb1d` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:50.725349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231a0f074ef44c338dd963f03531eb1d)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:50.729262 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:50.835321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231a0f074ef44c338dd963f03531eb1d', 'request_id': 'req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:50.847991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231a0f074ef44c338dd963f03531eb1d', 'request_id': 'req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:50.858434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231a0f074ef44c338dd963f03531eb1d', 'request_id': 'req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:50.879444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] The token cache is being invalidate because project 231a0f074ef44c338dd963f03531eb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:50.879793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:50.880692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c4dd9ed5-291d-437f-a5ae-f4464ee8dcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:50.882867 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1060/2101] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:50 2022] DELETE /identity/v3/projects/231a0f074ef44c338dd963f03531eb1d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:50.891584 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e0df5-4b3a-42c7-bf1d-ac78d942ec92 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:50.892824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e0df5-4b3a-42c7-bf1d-ac78d942ec92 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:50.894469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e0df5-4b3a-42c7-bf1d-ac78d942ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:50.927669 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7d6e0df5-4b3a-42c7-bf1d-ac78d942ec92 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:50.929967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7d6e0df5-4b3a-42c7-bf1d-ac78d942ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:51.061293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1042/2102] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:51.065497 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e446b02-0e78-4898-b931-0aa43d584c3a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:51.066443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e446b02-0e78-4898-b931-0aa43d584c3a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:51.067346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e446b02-0e78-4898-b931-0aa43d584c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:51.110529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-3e446b02-0e78-4898-b931-0aa43d584c3a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:51.112556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3e446b02-0e78-4898-b931-0aa43d584c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:51.128178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1061/2103] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:51.135871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e0df5-4b3a-42c7-bf1d-ac78d942ec92 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:51.156486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e0df5-4b3a-42c7-bf1d-ac78d942ec92 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:51.164447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e446b02-0e78-4898-b931-0aa43d584c3a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:51.166226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d41aa9-1e4e-40c7-8667-0cf38b76d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:51.166795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3e446b02-0e78-4898-b931-0aa43d584c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:51.168027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d41aa9-1e4e-40c7-8667-0cf38b76d78b admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:51.168027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d41aa9-1e4e-40c7-8667-0cf38b76d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:51.168382 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d41aa9-1e4e-40c7-8667-0cf38b76d78b admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:51.170061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d41aa9-1e4e-40c7-8667-0cf38b76d78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:51.170313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d41aa9-1e4e-40c7-8667-0cf38b76d78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:51.173647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d41aa9-1e4e-40c7-8667-0cf38b76d78b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:51.202806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1043/2104] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:51.209403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d41aa9-1e4e-40c7-8667-0cf38b76d78b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:51.228605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d41aa9-1e4e-40c7-8667-0cf38b76d78b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:51.241690 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1b619-966e-49d5-8e17-0bae04cac82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:51.243137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1b619-966e-49d5-8e17-0bae04cac82d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:51.243884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1b619-966e-49d5-8e17-0bae04cac82d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:51.244604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1b619-966e-49d5-8e17-0bae04cac82d admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:51.246336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1b619-966e-49d5-8e17-0bae04cac82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:51.250778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1b619-966e-49d5-8e17-0bae04cac82d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:51.290193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e446b02-0e78-4898-b931-0aa43d584c3a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:51.301967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b9b5d-7fa0-470c-964e-206020106053 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771edde4cad84fc5ad8db3ed7e63fdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee283e3419bd41fabf56dd77351bf8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:51.302957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b9b5d-7fa0-470c-964e-206020106053 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:51.303320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b9b5d-7fa0-470c-964e-206020106053 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:51.303796 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b9b5d-7fa0-470c-964e-206020106053 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:51.304695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b9b5d-7fa0-470c-964e-206020106053 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:51.305073 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b9b5d-7fa0-470c-964e-206020106053 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:51.306963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b9b5d-7fa0-470c-964e-206020106053 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:51.310799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1044/2105] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:51 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:51.312349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1b619-966e-49d5-8e17-0bae04cac82d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:51.317631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-15f1b619-966e-49d5-8e17-0bae04cac82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:51.331862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1062/2106] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:51.331862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b9b5d-7fa0-470c-964e-206020106053 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:51.349558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b9b5d-7fa0-470c-964e-206020106053 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:51.461084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1b619-966e-49d5-8e17-0bae04cac82d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:51.471901 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:51.474612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:51.474612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:51.475425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] PATH_INFO: `/v3/projects/993bbafbaa7d4848a6e9593c71e71857` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:51.477798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=993bbafbaa7d4848a6e9593c71e71857)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:51.481445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:51.488240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506edb83-6909-4939-ac14-807373e68236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:51.490671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506edb83-6909-4939-ac14-807373e68236 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:51.491263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506edb83-6909-4939-ac14-807373e68236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:51.492036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506edb83-6909-4939-ac14-807373e68236 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:51.493684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506edb83-6909-4939-ac14-807373e68236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:51.498820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506edb83-6909-4939-ac14-807373e68236 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:51.549490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1063/2107] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:51 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:51.552930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506edb83-6909-4939-ac14-807373e68236 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:51.577744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '993bbafbaa7d4848a6e9593c71e71857', 'request_id': 'req-88688e47-e55b-494a-b0cd-bf5465aa99fd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:51.605266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '993bbafbaa7d4848a6e9593c71e71857', 'request_id': 'req-88688e47-e55b-494a-b0cd-bf5465aa99fd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:51.605266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '993bbafbaa7d4848a6e9593c71e71857', 'request_id': 'req-88688e47-e55b-494a-b0cd-bf5465aa99fd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:51.615028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] The token cache is being invalidate because project 993bbafbaa7d4848a6e9593c71e71857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:51.615610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:51.616461 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:51.618317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1045/2108] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:51 2022] DELETE /identity/v3/projects/993bbafbaa7d4848a6e9593c71e71857 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:51.619384 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:51.621013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:51.661116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506edb83-6909-4939-ac14-807373e68236 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:51.713288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88688e47-e55b-494a-b0cd-bf5465aa99fd admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:51.718299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501c3e5-a7ef-4bbb-884b-8c04ecf381d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:51.719047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c3e5-a7ef-4bbb-884b-8c04ecf381d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:51.719320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c3e5-a7ef-4bbb-884b-8c04ecf381d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:51.719592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c3e5-a7ef-4bbb-884b-8c04ecf381d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:51.720341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501c3e5-a7ef-4bbb-884b-8c04ecf381d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:51.722119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501c3e5-a7ef-4bbb-884b-8c04ecf381d4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:51.734320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1046/2109] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:51.735210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501c3e5-a7ef-4bbb-884b-8c04ecf381d4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:51.741280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a501c3e5-a7ef-4bbb-884b-8c04ecf381d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:51.754995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3b4d9-7789-4e18-923a-d0c3e58ff1a4 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771edde4cad84fc5ad8db3ed7e63fdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee283e3419bd41fabf56dd77351bf8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:51.756097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3b4d9-7789-4e18-923a-d0c3e58ff1a4 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:51.756579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3b4d9-7789-4e18-923a-d0c3e58ff1a4 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:51.757059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3b4d9-7789-4e18-923a-d0c3e58ff1a4 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:51.758364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3b4d9-7789-4e18-923a-d0c3e58ff1a4 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:51.761881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3b4d9-7789-4e18-923a-d0c3e58ff1a4 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:51.769976 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501c3e5-a7ef-4bbb-884b-8c04ecf381d4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:51.783502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:51.784470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:51.784814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:51.785144 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] PATH_INFO: `/v3/users/108684f4a2bd46ada744d6daf4a1442c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:51.786499 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=108684f4a2bd46ada744d6daf4a1442c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:51.788813 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:51.805962 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1064/2110] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:51 2022] POST /identity/v3/projects => generated 355 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:51.807932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3b4d9-7789-4e18-923a-d0c3e58ff1a4 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:51.853503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108684f4a2bd46ada744d6daf4a1442c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:51.865377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108684f4a2bd46ada744d6daf4a1442c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:51.886638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108684f4a2bd46ada744d6daf4a1442c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:51.887814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108684f4a2bd46ada744d6daf4a1442c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:51.899809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108684f4a2bd46ada744d6daf4a1442c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:51.910225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3b4d9-7789-4e18-923a-d0c3e58ff1a4 tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:51.910644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1047/2111] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:51 2022] DELETE /identity/v3/users/108684f4a2bd46ada744d6daf4a1442c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:51.915495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:51.915495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.021668 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbb09f-e78f-498b-ae15-0512c265af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.022697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbb09f-e78f-498b-ae15-0512c265af0d admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.023888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbb09f-e78f-498b-ae15-0512c265af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.024346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbb09f-e78f-498b-ae15-0512c265af0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.026137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbb09f-e78f-498b-ae15-0512c265af0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:52.029184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbb09f-e78f-498b-ae15-0512c265af0d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:52.042110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01762250-dcda-4582-9544-85dbe954d2d4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:52.046308 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1065/2112] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:52.051120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9702c00-432a-407a-8e07-3e7dcf93b29d tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771edde4cad84fc5ad8db3ed7e63fdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee283e3419bd41fabf56dd77351bf8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.051907 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbb09f-e78f-498b-ae15-0512c265af0d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:52.052487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9702c00-432a-407a-8e07-3e7dcf93b29d tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.053256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9702c00-432a-407a-8e07-3e7dcf93b29d tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.053738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9702c00-432a-407a-8e07-3e7dcf93b29d tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.053931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-23bbb09f-e78f-498b-ae15-0512c265af0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.055089 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9702c00-432a-407a-8e07-3e7dcf93b29d tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:52.055620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9702c00-432a-407a-8e07-3e7dcf93b29d tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:52.059080 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9702c00-432a-407a-8e07-3e7dcf93b29d tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:52.068224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbb09f-e78f-498b-ae15-0512c265af0d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:52.074341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83852741-0a42-4bf4-90c1-a7e8c48744fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.075472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83852741-0a42-4bf4-90c1-a7e8c48744fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.075963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83852741-0a42-4bf4-90c1-a7e8c48744fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.076250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83852741-0a42-4bf4-90c1-a7e8c48744fd admin admin] PATH_INFO: `/v3/projects/98168d53c3604321bf616b373972d0fa/users/81cef5cf1c45458bba4ddac94893f260/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.084228 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1048/2113] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:52.104406 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83852741-0a42-4bf4-90c1-a7e8c48744fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=98168d53c3604321bf616b373972d0fa, user_id=81cef5cf1c45458bba4ddac94893f260, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:52.111139 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83852741-0a42-4bf4-90c1-a7e8c48744fd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:52.131093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9702c00-432a-407a-8e07-3e7dcf93b29d tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:52.131912 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1066/2114] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:52 2022] PUT /identity/v3/projects/98168d53c3604321bf616b373972d0fa/users/81cef5cf1c45458bba4ddac94893f260/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:52.148935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6d181-9da3-48d3-90ad-ad079e4f33cf None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.149207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6d181-9da3-48d3-90ad-ad079e4f33cf None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.149420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6d181-9da3-48d3-90ad-ad079e4f33cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.157817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9702c00-432a-407a-8e07-3e7dcf93b29d tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:52.196333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-eef6d181-9da3-48d3-90ad-ad079e4f33cf None None] MFA Rules not processed for user `81cef5cf1c45458bba4ddac94893f260`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:52.198090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-eef6d181-9da3-48d3-90ad-ad079e4f33cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.254775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '771edde4cad84fc5ad8db3ed7e63fdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee283e3419bd41fabf56dd77351bf8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.256390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.256873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.257425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] PATH_INFO: `/v3/projects/cfd978bb0f674e6281db4f03e45dc939` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.259787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cfd978bb0f674e6281db4f03e45dc939)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:52.264500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:52.320523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1067/2115] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:52.325633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6d181-9da3-48d3-90ad-ad079e4f33cf None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:52.366105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd978bb0f674e6281db4f03e45dc939', 'request_id': 'req-3f935092-be78-4b9d-a5ad-7d65bc272aea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.390964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd978bb0f674e6281db4f03e45dc939', 'request_id': 'req-3f935092-be78-4b9d-a5ad-7d65bc272aea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.401108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd978bb0f674e6281db4f03e45dc939', 'request_id': 'req-3f935092-be78-4b9d-a5ad-7d65bc272aea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.414171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] The token cache is being invalidate because project cfd978bb0f674e6281db4f03e45dc939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:52.414646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.415651 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.418615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1049/2116] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:52 2022] DELETE /identity/v3/projects/cfd978bb0f674e6281db4f03e45dc939 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:52.419901 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:52.421916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.428049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6d181-9da3-48d3-90ad-ad079e4f33cf None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:52.492690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dacff0-892f-4735-b1a3-7d2e5ea87e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.493397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dacff0-892f-4735-b1a3-7d2e5ea87e9e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.493673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dacff0-892f-4735-b1a3-7d2e5ea87e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.493957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dacff0-892f-4735-b1a3-7d2e5ea87e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.495088 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dacff0-892f-4735-b1a3-7d2e5ea87e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:52.502693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dacff0-892f-4735-b1a3-7d2e5ea87e9e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:52.502889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f935092-be78-4b9d-a5ad-7d65bc272aea tempest-VolumeQuotaClassesTest-351863011 tempest-VolumeQuotaClassesTest-351863011-project-admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:52.514272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.515013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.515287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.515557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] PATH_INFO: `/v3/projects/802d11609ce145449b685ec0ac0c51b3` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.517203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=802d11609ce145449b685ec0ac0c51b3)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:52.518917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:52.541083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1068/2117] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:52 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:52.543387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dacff0-892f-4735-b1a3-7d2e5ea87e9e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:52.547487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-03dacff0-892f-4735-b1a3-7d2e5ea87e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.587905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802d11609ce145449b685ec0ac0c51b3', 'request_id': 'req-01623d79-ae46-4a33-a29e-b1cb93ba10aa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.602440 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802d11609ce145449b685ec0ac0c51b3', 'request_id': 'req-01623d79-ae46-4a33-a29e-b1cb93ba10aa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.612975 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802d11609ce145449b685ec0ac0c51b3', 'request_id': 'req-01623d79-ae46-4a33-a29e-b1cb93ba10aa'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.634214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] The token cache is being invalidate because project 802d11609ce145449b685ec0ac0c51b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:52.637946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.641805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-01623d79-ae46-4a33-a29e-b1cb93ba10aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.644032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1050/2118] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:52 2022] DELETE /identity/v3/projects/802d11609ce145449b685ec0ac0c51b3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:52.649830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb693-b522-4e42-853a-2f11baed7271 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.650116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb693-b522-4e42-853a-2f11baed7271 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.650394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb693-b522-4e42-853a-2f11baed7271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.670197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-439bb693-b522-4e42-853a-2f11baed7271 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:52.671428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-439bb693-b522-4e42-853a-2f11baed7271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.676111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dacff0-892f-4735-b1a3-7d2e5ea87e9e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:52.746540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7ff3-d216-46ab-b2cc-0adecb707bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.747385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7ff3-d216-46ab-b2cc-0adecb707bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.747755 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7ff3-d216-46ab-b2cc-0adecb707bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.748117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7ff3-d216-46ab-b2cc-0adecb707bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.749373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df7ff3-d216-46ab-b2cc-0adecb707bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:52.757606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df7ff3-d216-46ab-b2cc-0adecb707bf7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:52.759996 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1051/2119] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:52.761046 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb693-b522-4e42-853a-2f11baed7271 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:52.762361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-439bb693-b522-4e42-853a-2f11baed7271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.774753 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb693-b522-4e42-853a-2f11baed7271 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:52.779929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.780948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.781463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.781688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] PATH_INFO: `/v3/users/f97e2ddfde6c4445ade2b1d56629d5a3` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.783156 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97e2ddfde6c4445ade2b1d56629d5a3)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:52.785204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:52.793389 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1069/2120] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:52 2022] POST /identity/v3/users => generated 296 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:52.793389 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e39c5-143f-4569-8b91-35db23f885cb None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.793389 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e39c5-143f-4569-8b91-35db23f885cb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.793389 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e39c5-143f-4569-8b91-35db23f885cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.813045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-005e39c5-143f-4569-8b91-35db23f885cb None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:52.814768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-005e39c5-143f-4569-8b91-35db23f885cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.837716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1070/2121] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:52.839175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e39c5-143f-4569-8b91-35db23f885cb None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:52.840981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-005e39c5-143f-4569-8b91-35db23f885cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.854882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97e2ddfde6c4445ade2b1d56629d5a3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.856758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e39c5-143f-4569-8b91-35db23f885cb None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:52.862486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa02235-8904-4597-9245-74000c0139c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.863377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02235-8904-4597-9245-74000c0139c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.863799 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02235-8904-4597-9245-74000c0139c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.864202 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02235-8904-4597-9245-74000c0139c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.865126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa02235-8904-4597-9245-74000c0139c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:52.866788 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa02235-8904-4597-9245-74000c0139c3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:52.867440 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97e2ddfde6c4445ade2b1d56629d5a3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.885462 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1071/2122] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:52.885462 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa02235-8904-4597-9245-74000c0139c3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:52.885965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97e2ddfde6c4445ade2b1d56629d5a3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.885965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97e2ddfde6c4445ade2b1d56629d5a3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.888882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-cfa02235-8904-4597-9245-74000c0139c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.893366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97e2ddfde6c4445ade2b1d56629d5a3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:52.900688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1052/2123] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:52 2022] DELETE /identity/v3/users/f97e2ddfde6c4445ade2b1d56629d5a3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:52.901568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:52.903043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:52.904176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa02235-8904-4597-9245-74000c0139c3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:52.987542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca71d5-f318-459c-8439-413f704b578f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:52.994104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f435ca-82e5-41b1-903c-f8796e8f812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.995302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f435ca-82e5-41b1-903c-f8796e8f812c admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.995610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f435ca-82e5-41b1-903c-f8796e8f812c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:52.996106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f435ca-82e5-41b1-903c-f8796e8f812c admin admin] PATH_INFO: `/v3/projects/d6f30491243843db88f7de477b0e5a80/users/22320a33b4c84dd18e5e91b74d618073/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:52.998224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d053c9-0517-4bad-8176-82b0cdc33700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:52.999216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d053c9-0517-4bad-8176-82b0cdc33700 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:52.999644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d053c9-0517-4bad-8176-82b0cdc33700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.000078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d053c9-0517-4bad-8176-82b0cdc33700 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.001211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d053c9-0517-4bad-8176-82b0cdc33700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:53.001729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d053c9-0517-4bad-8176-82b0cdc33700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.004331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d053c9-0517-4bad-8176-82b0cdc33700 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.011447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f435ca-82e5-41b1-903c-f8796e8f812c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f30491243843db88f7de477b0e5a80, user_id=22320a33b4c84dd18e5e91b74d618073, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.014303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f435ca-82e5-41b1-903c-f8796e8f812c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.020865 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1072/2124] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:53.023256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38127f-d109-4450-9e01-2d72673ecf66 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.023256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38127f-d109-4450-9e01-2d72673ecf66 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.023256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38127f-d109-4450-9e01-2d72673ecf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.034607 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1053/2125] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:52 2022] PUT /identity/v3/projects/d6f30491243843db88f7de477b0e5a80/users/22320a33b4c84dd18e5e91b74d618073/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:53.036081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f435ca-82e5-41b1-903c-f8796e8f812c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.043450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-5d38127f-d109-4450-9e01-2d72673ecf66 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:53.044660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5d38127f-d109-4450-9e01-2d72673ecf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:53.106587 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f435ca-82e5-41b1-903c-f8796e8f812c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.113127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14231c0c-a5a2-411a-be35-429e2c44eb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.114152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14231c0c-a5a2-411a-be35-429e2c44eb44 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.114587 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14231c0c-a5a2-411a-be35-429e2c44eb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.115000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14231c0c-a5a2-411a-be35-429e2c44eb44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.116111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14231c0c-a5a2-411a-be35-429e2c44eb44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.119279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14231c0c-a5a2-411a-be35-429e2c44eb44 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.120677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1073/2126] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:53.121958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38127f-d109-4450-9e01-2d72673ecf66 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.131736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38127f-d109-4450-9e01-2d72673ecf66 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.136817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d595e-69c1-4ca7-905c-a0a962d59100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.137629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d595e-69c1-4ca7-905c-a0a962d59100 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.137907 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d595e-69c1-4ca7-905c-a0a962d59100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.138177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d595e-69c1-4ca7-905c-a0a962d59100 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.138918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d595e-69c1-4ca7-905c-a0a962d59100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.140547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d595e-69c1-4ca7-905c-a0a962d59100 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.153654 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1074/2127] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:53.154696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d595e-69c1-4ca7-905c-a0a962d59100 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.156662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f55d595e-69c1-4ca7-905c-a0a962d59100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:53.158887 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1054/2128] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:53 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:53.160403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14231c0c-a5a2-411a-be35-429e2c44eb44 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.217686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d595e-69c1-4ca7-905c-a0a962d59100 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.228399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14231c0c-a5a2-411a-be35-429e2c44eb44 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.233534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8a5e6-dadf-4a19-ad7c-b921bac52e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.234544 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8a5e6-dadf-4a19-ad7c-b921bac52e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.234821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8a5e6-dadf-4a19-ad7c-b921bac52e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.235227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8a5e6-dadf-4a19-ad7c-b921bac52e32 admin admin] PATH_INFO: `/v3/projects/d6f30491243843db88f7de477b0e5a80/users/22320a33b4c84dd18e5e91b74d618073/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.237278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8a5e6-dadf-4a19-ad7c-b921bac52e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f30491243843db88f7de477b0e5a80, user_id=22320a33b4c84dd18e5e91b74d618073, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.240121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8a5e6-dadf-4a19-ad7c-b921bac52e32 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.253357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1055/2129] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:53 2022] PUT /identity/v3/projects/d6f30491243843db88f7de477b0e5a80/users/22320a33b4c84dd18e5e91b74d618073/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:53.255579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8a5e6-dadf-4a19-ad7c-b921bac52e32 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.270317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13633bf-9984-4128-b14f-e62eda9755ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.270988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13633bf-9984-4128-b14f-e62eda9755ef service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.271293 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13633bf-9984-4128-b14f-e62eda9755ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.271570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13633bf-9984-4128-b14f-e62eda9755ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.285550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13633bf-9984-4128-b14f-e62eda9755ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.287927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13633bf-9984-4128-b14f-e62eda9755ef service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.301279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1075/2130] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:53.301279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3c11-ae8f-4f85-9467-a841e8a60a9c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.301564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3c11-ae8f-4f85-9467-a841e8a60a9c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.301818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b3c11-ae8f-4f85-9467-a841e8a60a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.346475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8a5e6-dadf-4a19-ad7c-b921bac52e32 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.347747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-c00b3c11-ae8f-4f85-9467-a841e8a60a9c None None] MFA Rules not processed for user `22320a33b4c84dd18e5e91b74d618073`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:53.351438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c00b3c11-ae8f-4f85-9467-a841e8a60a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:53.353375 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae90b50-17f6-4d99-b77b-56f1713c021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.354174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae90b50-17f6-4d99-b77b-56f1713c021e admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.354520 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae90b50-17f6-4d99-b77b-56f1713c021e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.354863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae90b50-17f6-4d99-b77b-56f1713c021e admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.356246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae90b50-17f6-4d99-b77b-56f1713c021e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.359023 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae90b50-17f6-4d99-b77b-56f1713c021e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.382938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1056/2131] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:53 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:53.386628 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae90b50-17f6-4d99-b77b-56f1713c021e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.397528 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae90b50-17f6-4d99-b77b-56f1713c021e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.402884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574a05-1645-416c-acbd-14c80e9b6981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.403785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574a05-1645-416c-acbd-14c80e9b6981 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.404184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574a05-1645-416c-acbd-14c80e9b6981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.404515 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574a05-1645-416c-acbd-14c80e9b6981 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.405366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574a05-1645-416c-acbd-14c80e9b6981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.407277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574a05-1645-416c-acbd-14c80e9b6981 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.422621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1057/2132] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:53.423559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574a05-1645-416c-acbd-14c80e9b6981 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.434904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574a05-1645-416c-acbd-14c80e9b6981 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.442746 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c33084-7cfc-4764-97e6-a1ea12460510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.443784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c33084-7cfc-4764-97e6-a1ea12460510 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.444283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c33084-7cfc-4764-97e6-a1ea12460510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.444796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c33084-7cfc-4764-97e6-a1ea12460510 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.445707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c33084-7cfc-4764-97e6-a1ea12460510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.447108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c33084-7cfc-4764-97e6-a1ea12460510 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.467396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1058/2133] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:53.470768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c33084-7cfc-4764-97e6-a1ea12460510 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.473949 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1076/2134] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:53.486774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b3c11-ae8f-4f85-9467-a841e8a60a9c None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.487568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c33084-7cfc-4764-97e6-a1ea12460510 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.488687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c00b3c11-ae8f-4f85-9467-a841e8a60a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:53.495870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473dde4-e0c7-482f-9b3a-87f9c7fd4fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.497346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473dde4-e0c7-482f-9b3a-87f9c7fd4fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.497795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473dde4-e0c7-482f-9b3a-87f9c7fd4fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.498232 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473dde4-e0c7-482f-9b3a-87f9c7fd4fb9 admin admin] PATH_INFO: `/v3/projects/6263c4e9b32046e78a33e462028c5460/users/5650be995fdb43c9ab03149fdf5f9758/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.524041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473dde4-e0c7-482f-9b3a-87f9c7fd4fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6263c4e9b32046e78a33e462028c5460, user_id=5650be995fdb43c9ab03149fdf5f9758, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.528485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473dde4-e0c7-482f-9b3a-87f9c7fd4fb9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.553616 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1059/2135] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:53 2022] PUT /identity/v3/projects/6263c4e9b32046e78a33e462028c5460/users/5650be995fdb43c9ab03149fdf5f9758/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:53.573246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6ce8-e772-4e61-8dea-79df85db61af None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.574361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6ce8-e772-4e61-8dea-79df85db61af None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.574361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6ce8-e772-4e61-8dea-79df85db61af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.588901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b3c11-ae8f-4f85-9467-a841e8a60a9c None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.616320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f7ca6ce8-e772-4e61-8dea-79df85db61af None None] MFA Rules not processed for user `5650be995fdb43c9ab03149fdf5f9758`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:53.618649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f7ca6ce8-e772-4e61-8dea-79df85db61af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:53.684446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67307429-40e4-4bee-8f08-cbe3d2d860b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.685625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67307429-40e4-4bee-8f08-cbe3d2d860b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.686139 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67307429-40e4-4bee-8f08-cbe3d2d860b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.686671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67307429-40e4-4bee-8f08-cbe3d2d860b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.748329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1060/2136] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:53.754079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6ce8-e772-4e61-8dea-79df85db61af None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.754079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f7ca6ce8-e772-4e61-8dea-79df85db61af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:53.775162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67307429-40e4-4bee-8f08-cbe3d2d860b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.777157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67307429-40e4-4bee-8f08-cbe3d2d860b8 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.790299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1077/2137] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:26:53.790929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67307429-40e4-4bee-8f08-cbe3d2d860b8 service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.792977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-67307429-40e4-4bee-8f08-cbe3d2d860b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:53.812597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67307429-40e4-4bee-8f08-cbe3d2d860b8 service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.818888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6565c4-48dc-4253-9a06-d3612466997e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.819997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6565c4-48dc-4253-9a06-d3612466997e service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.820481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6565c4-48dc-4253-9a06-d3612466997e service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.820955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6565c4-48dc-4253-9a06-d3612466997e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.828332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6ce8-e772-4e61-8dea-79df85db61af None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.834926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:53.835864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:53.836212 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:53.836550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] PATH_INFO: `/v3/projects/eb533a169f4f438c8fd15efb76bc79c1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:53.838176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb533a169f4f438c8fd15efb76bc79c1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.838972 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6565c4-48dc-4253-9a06-d3612466997e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:53.840303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.842439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6565c4-48dc-4253-9a06-d3612466997e service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:53.871749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1078/2138] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:53.905168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb533a169f4f438c8fd15efb76bc79c1', 'request_id': 'req-63448caa-251c-4085-89b1-5c68d1d0d918'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:53.915994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb533a169f4f438c8fd15efb76bc79c1', 'request_id': 'req-63448caa-251c-4085-89b1-5c68d1d0d918'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:53.925561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb533a169f4f438c8fd15efb76bc79c1', 'request_id': 'req-63448caa-251c-4085-89b1-5c68d1d0d918'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:53.939049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] The token cache is being invalidate because project eb533a169f4f438c8fd15efb76bc79c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:53.939426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:53.940635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:53.942437 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1061/2139] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:53 2022] DELETE /identity/v3/projects/eb533a169f4f438c8fd15efb76bc79c1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:53.955022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6565c4-48dc-4253-9a06-d3612466997e service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.973898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6565c4-48dc-4253-9a06-d3612466997e service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:53.987434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:53.989328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:54.062505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63448caa-251c-4085-89b1-5c68d1d0d918 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:54.068530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309782fb-0653-414b-ac51-ab433be0dd65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:54.069472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309782fb-0653-414b-ac51-ab433be0dd65 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:54.069819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309782fb-0653-414b-ac51-ab433be0dd65 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:54.070619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309782fb-0653-414b-ac51-ab433be0dd65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:54.073860 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-309782fb-0653-414b-ac51-ab433be0dd65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:54.108740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:54.109666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:54.110172 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:54.110451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] PATH_INFO: `/v3/users/771edde4cad84fc5ad8db3ed7e63fdd3` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:54.111747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=771edde4cad84fc5ad8db3ed7e63fdd3)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:54.114056 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:54.194985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771edde4cad84fc5ad8db3ed7e63fdd3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:54.200426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309782fb-0653-414b-ac51-ab433be0dd65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:54.202784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309782fb-0653-414b-ac51-ab433be0dd65 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:54.231496 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1062/2140] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:26:54.233187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771edde4cad84fc5ad8db3ed7e63fdd3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:54.240938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771edde4cad84fc5ad8db3ed7e63fdd3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:54.270648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771edde4cad84fc5ad8db3ed7e63fdd3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:54.331701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d2c991c6-1cd5-44bf-a0ce-2127b09517ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771edde4cad84fc5ad8db3ed7e63fdd3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:54.358317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1079/2141] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:26:53 2022] DELETE /identity/v3/users/771edde4cad84fc5ad8db3ed7e63fdd3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:54.827639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309782fb-0653-414b-ac51-ab433be0dd65 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:54.829825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-309782fb-0653-414b-ac51-ab433be0dd65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:54.860679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309782fb-0653-414b-ac51-ab433be0dd65 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:54.977939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:54.979138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:54.979419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:54.980501 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] PATH_INFO: `/v3/projects/ee283e3419bd41fabf56dd77351bf8c1` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:54.981927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee283e3419bd41fabf56dd77351bf8c1)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:54.984519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:55.066280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee283e3419bd41fabf56dd77351bf8c1', 'request_id': 'req-c32fead8-2ac8-458e-bda4-b116c03c1d2e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:55.081536 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee283e3419bd41fabf56dd77351bf8c1', 'request_id': 'req-c32fead8-2ac8-458e-bda4-b116c03c1d2e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:55.090678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee283e3419bd41fabf56dd77351bf8c1', 'request_id': 'req-c32fead8-2ac8-458e-bda4-b116c03c1d2e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:55.107300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] The token cache is being invalidate because project ee283e3419bd41fabf56dd77351bf8c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:26:55.107612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:55.108464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c32fead8-2ac8-458e-bda4-b116c03c1d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:26:55.110594 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1063/2142] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:26:54 2022] DELETE /identity/v3/projects/ee283e3419bd41fabf56dd77351bf8c1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:26:55.119672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe1cf4-7f2c-4e0d-b866-0f3836f3b53f None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:55.120483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe1cf4-7f2c-4e0d-b866-0f3836f3b53f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:55.120483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe1cf4-7f2c-4e0d-b866-0f3836f3b53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:55.146400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4ffe1cf4-7f2c-4e0d-b866-0f3836f3b53f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:55.148542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4ffe1cf4-7f2c-4e0d-b866-0f3836f3b53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:55.267284 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1080/2143] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:26:55.283190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763a99-cd01-4c6a-8366-78e47a71981c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:55.284147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763a99-cd01-4c6a-8366-78e47a71981c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:55.284147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763a99-cd01-4c6a-8366-78e47a71981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:55.316892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7c763a99-cd01-4c6a-8366-78e47a71981c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:55.319067 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7c763a99-cd01-4c6a-8366-78e47a71981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:55.333683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1064/2144] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:55.340711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe1cf4-7f2c-4e0d-b866-0f3836f3b53f None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:55.361001 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe1cf4-7f2c-4e0d-b866-0f3836f3b53f None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:55.369323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8044f4e-7fc0-4633-9ef3-664e3df95dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:55.371291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044f4e-7fc0-4633-9ef3-664e3df95dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:55.371291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044f4e-7fc0-4633-9ef3-664e3df95dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:55.371291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8044f4e-7fc0-4633-9ef3-664e3df95dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:55.372400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8044f4e-7fc0-4633-9ef3-664e3df95dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:26:55.372794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8044f4e-7fc0-4633-9ef3-664e3df95dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:55.375771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8044f4e-7fc0-4633-9ef3-664e3df95dc2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:55.400068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1081/2145] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:26:55.406130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c763a99-cd01-4c6a-8366-78e47a71981c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:55.421644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c763a99-cd01-4c6a-8366-78e47a71981c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:55.429648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d017-082b-47e0-a3d0-bc7acca4f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:55.430555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d017-082b-47e0-a3d0-bc7acca4f05d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:55.431126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d017-082b-47e0-a3d0-bc7acca4f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:55.431614 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d017-082b-47e0-a3d0-bc7acca4f05d admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:55.432921 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d017-082b-47e0-a3d0-bc7acca4f05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:55.436543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d017-082b-47e0-a3d0-bc7acca4f05d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:55.507963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1065/2146] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:55 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:55.509707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8044f4e-7fc0-4633-9ef3-664e3df95dc2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:55.527261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8044f4e-7fc0-4633-9ef3-664e3df95dc2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:55.668101 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07532df-e603-4ef1-a868-ac62b3387aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:55.668978 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07532df-e603-4ef1-a868-ac62b3387aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:55.669457 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07532df-e603-4ef1-a868-ac62b3387aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:55.669976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07532df-e603-4ef1-a868-ac62b3387aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:55.671361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07532df-e603-4ef1-a868-ac62b3387aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:55.673200 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07532df-e603-4ef1-a868-ac62b3387aa2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:55.714533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1082/2147] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:55 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:55.718703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d017-082b-47e0-a3d0-bc7acca4f05d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:55.746084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d017-082b-47e0-a3d0-bc7acca4f05d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:55.752377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02efec8-1574-418a-b001-16cce0557f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:55.753275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02efec8-1574-418a-b001-16cce0557f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:55.753658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02efec8-1574-418a-b001-16cce0557f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:55.754024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02efec8-1574-418a-b001-16cce0557f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:55.755528 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02efec8-1574-418a-b001-16cce0557f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:55.756706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02efec8-1574-418a-b001-16cce0557f97 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:55.776088 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1066/2148] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:55.778043 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07532df-e603-4ef1-a868-ac62b3387aa2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:55.795101 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07532df-e603-4ef1-a868-ac62b3387aa2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:55.803657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdaa77-be3a-40da-96ac-a47cc76b8a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:55.805041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdaa77-be3a-40da-96ac-a47cc76b8a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:55.805674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdaa77-be3a-40da-96ac-a47cc76b8a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:55.806241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdaa77-be3a-40da-96ac-a47cc76b8a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:55.807751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdaa77-be3a-40da-96ac-a47cc76b8a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:55.814290 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdaa77-be3a-40da-96ac-a47cc76b8a8a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:55.829551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1083/2149] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:55.835441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02efec8-1574-418a-b001-16cce0557f97 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:55.851491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02efec8-1574-418a-b001-16cce0557f97 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:55.859032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782d060-9557-42e7-bef3-d8945cc32ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:55.861054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782d060-9557-42e7-bef3-d8945cc32ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:55.861576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782d060-9557-42e7-bef3-d8945cc32ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:55.862048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782d060-9557-42e7-bef3-d8945cc32ed9 admin admin] PATH_INFO: `/v3/projects/bb675562301f4fda9862f03daef5ac85/users/f252c786c3d541c180ceca2e0f9f72bf/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:55.893765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782d060-9557-42e7-bef3-d8945cc32ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb675562301f4fda9862f03daef5ac85, user_id=f252c786c3d541c180ceca2e0f9f72bf, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:55.896469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782d060-9557-42e7-bef3-d8945cc32ed9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:55.915070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1067/2150] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:55 2022] PUT /identity/v3/projects/bb675562301f4fda9862f03daef5ac85/users/f252c786c3d541c180ceca2e0f9f72bf/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:55.938585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2647ce-1dae-4485-8c71-7a33fd0461a5 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:55.939173 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2647ce-1dae-4485-8c71-7a33fd0461a5 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:55.939786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2647ce-1dae-4485-8c71-7a33fd0461a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:55.997586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-cd2647ce-1dae-4485-8c71-7a33fd0461a5 None None] MFA Rules not processed for user `f252c786c3d541c180ceca2e0f9f72bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:56.000175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-cd2647ce-1dae-4485-8c71-7a33fd0461a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:56.149769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1084/2151] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:56.153149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782d060-9557-42e7-bef3-d8945cc32ed9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:56.276610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782d060-9557-42e7-bef3-d8945cc32ed9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:56.283884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca5604-41cf-449e-afb5-21a5d647ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:56.284659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca5604-41cf-449e-afb5-21a5d647ab13 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:56.284950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca5604-41cf-449e-afb5-21a5d647ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:56.285353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca5604-41cf-449e-afb5-21a5d647ab13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:56.286115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca5604-41cf-449e-afb5-21a5d647ab13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:56.289426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca5604-41cf-449e-afb5-21a5d647ab13 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:56.329453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1068/2152] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:26:56 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:26:56.337380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2647ce-1dae-4485-8c71-7a33fd0461a5 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:56.358186 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2647ce-1dae-4485-8c71-7a33fd0461a5 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:56.440986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48e58-1db4-4dc3-a755-2ebeb66255dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:56.441783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48e58-1db4-4dc3-a755-2ebeb66255dc admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:56.442062 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48e58-1db4-4dc3-a755-2ebeb66255dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:56.442433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa48e58-1db4-4dc3-a755-2ebeb66255dc admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:56.443211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa48e58-1db4-4dc3-a755-2ebeb66255dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:56.445682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa48e58-1db4-4dc3-a755-2ebeb66255dc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:56.471067 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1085/2153] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:26:56 2022] POST /identity/v3/users => generated 303 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:26:56.474816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca5604-41cf-449e-afb5-21a5d647ab13 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:56.493273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca5604-41cf-449e-afb5-21a5d647ab13 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:56.498482 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631c9bf-ed2a-479d-9d22-bb94b765c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:56.499184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631c9bf-ed2a-479d-9d22-bb94b765c5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:56.499467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631c9bf-ed2a-479d-9d22-bb94b765c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:56.499737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631c9bf-ed2a-479d-9d22-bb94b765c5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:56.500503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631c9bf-ed2a-479d-9d22-bb94b765c5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:56.502517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631c9bf-ed2a-479d-9d22-bb94b765c5a4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:56.514969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1069/2154] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:26:56.521878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48e58-1db4-4dc3-a755-2ebeb66255dc admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:56.537769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa48e58-1db4-4dc3-a755-2ebeb66255dc admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:56.544643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d823-504e-493e-8791-034f664021a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:56.545743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d823-504e-493e-8791-034f664021a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:56.546156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d823-504e-493e-8791-034f664021a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:56.546519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d823-504e-493e-8791-034f664021a1 admin admin] PATH_INFO: `/v3/projects/72e6f143ed304f82b7e927578dcd9dbd/users/a1b8b957f3e64e10b4c908fa6d681387/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:56.576782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548d823-504e-493e-8791-034f664021a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e6f143ed304f82b7e927578dcd9dbd, user_id=a1b8b957f3e64e10b4c908fa6d681387, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:56.580611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548d823-504e-493e-8791-034f664021a1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:56.603458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1086/2155] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:56 2022] PUT /identity/v3/projects/72e6f143ed304f82b7e927578dcd9dbd/users/a1b8b957f3e64e10b4c908fa6d681387/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:56.608398 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631c9bf-ed2a-479d-9d22-bb94b765c5a4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:56.630181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631c9bf-ed2a-479d-9d22-bb94b765c5a4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:56.708138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a0f26-f2ba-4a19-a42f-f6d0bd525666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:56.709215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a0f26-f2ba-4a19-a42f-f6d0bd525666 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:56.709726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a0f26-f2ba-4a19-a42f-f6d0bd525666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:56.710175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a0f26-f2ba-4a19-a42f-f6d0bd525666 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:56.711415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a0f26-f2ba-4a19-a42f-f6d0bd525666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:56.714016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a0f26-f2ba-4a19-a42f-f6d0bd525666 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:56.732707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1070/2156] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:26:56.738901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d823-504e-493e-8791-034f664021a1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:56.758367 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d823-504e-493e-8791-034f664021a1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:56.774560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e366961-e881-4344-9a4c-cfdd8802691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:56.776204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e366961-e881-4344-9a4c-cfdd8802691d admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:56.776657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e366961-e881-4344-9a4c-cfdd8802691d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:56.777105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e366961-e881-4344-9a4c-cfdd8802691d admin admin] PATH_INFO: `/v3/projects/72e6f143ed304f82b7e927578dcd9dbd/users/a1b8b957f3e64e10b4c908fa6d681387/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:56.780699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e366961-e881-4344-9a4c-cfdd8802691d admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e6f143ed304f82b7e927578dcd9dbd, user_id=a1b8b957f3e64e10b4c908fa6d681387, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:56.788477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e366961-e881-4344-9a4c-cfdd8802691d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:56.806569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1087/2157] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:26:56 2022] PUT /identity/v3/projects/72e6f143ed304f82b7e927578dcd9dbd/users/a1b8b957f3e64e10b4c908fa6d681387/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:26:56.820098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a022b27-29af-4426-9596-5984a9e2ba29 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:56.820573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a022b27-29af-4426-9596-5984a9e2ba29 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:56.821033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a022b27-29af-4426-9596-5984a9e2ba29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:56.863227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7a022b27-29af-4426-9596-5984a9e2ba29 None None] MFA Rules not processed for user `a1b8b957f3e64e10b4c908fa6d681387`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:26:56.864926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7a022b27-29af-4426-9596-5984a9e2ba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:56.984550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1071/2158] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:26:56.995871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e366961-e881-4344-9a4c-cfdd8802691d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:56.998629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7e366961-e881-4344-9a4c-cfdd8802691d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:26:57.079445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e366961-e881-4344-9a4c-cfdd8802691d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:57.085642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f0dd5-b3b6-4e7d-a173-4d586272a2ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:57.086640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f0dd5-b3b6-4e7d-a173-4d586272a2ad service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:57.087095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f0dd5-b3b6-4e7d-a173-4d586272a2ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:57.087378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f0dd5-b3b6-4e7d-a173-4d586272a2ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:57.100188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f0dd5-b3b6-4e7d-a173-4d586272a2ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:57.102171 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f0dd5-b3b6-4e7d-a173-4d586272a2ad service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:57.116795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1088/2159] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:26:57.182499 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a022b27-29af-4426-9596-5984a9e2ba29 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:26:57.194555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a022b27-29af-4426-9596-5984a9e2ba29 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:26:57.199547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700deec-361a-429e-98a7-c3f339e653ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:26:57.200537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700deec-361a-429e-98a7-c3f339e653ea service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:26:57.200889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700deec-361a-429e-98a7-c3f339e653ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:26:57.201220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700deec-361a-429e-98a7-c3f339e653ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:26:57.294478 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700deec-361a-429e-98a7-c3f339e653ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:26:57.296027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700deec-361a-429e-98a7-c3f339e653ea service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:26:57.306821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1072/2160] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:26:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:17.902268 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f0dd5-b3b6-4e7d-a173-4d586272a2ad service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:17.905024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3e3f0dd5-b3b6-4e7d-a173-4d586272a2ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:18.014624 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f0dd5-b3b6-4e7d-a173-4d586272a2ad service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:18.023615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:18.025083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:18.025735 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:18.026119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] PATH_INFO: `/v3/users/81cef5cf1c45458bba4ddac94893f260` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:18.033076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81cef5cf1c45458bba4ddac94893f260)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:18.036962 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:18.134983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81cef5cf1c45458bba4ddac94893f260'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:18.144011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81cef5cf1c45458bba4ddac94893f260'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:18.145102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81cef5cf1c45458bba4ddac94893f260'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:18.159853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81cef5cf1c45458bba4ddac94893f260'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:18.178215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81cef5cf1c45458bba4ddac94893f260'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:18.186440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1089/2161] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:17 2022] DELETE /identity/v3/users/81cef5cf1c45458bba4ddac94893f260 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:18.193588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb1124-9a0c-4ded-b664-d8657fd4bdfb None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:18.194255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb1124-9a0c-4ded-b664-d8657fd4bdfb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:18.194255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb1124-9a0c-4ded-b664-d8657fd4bdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:18.224933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:18.227099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6ddb1124-9a0c-4ded-b664-d8657fd4bdfb None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:18.227318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:18.229422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6ddb1124-9a0c-4ded-b664-d8657fd4bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:18.369614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439063-ba2f-4962-baed-8ede4b51ff56 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:18.375712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1073/2162] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:18.378194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:18.380061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:18.380658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:18.381101 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] PATH_INFO: `/v3/users/f252c786c3d541c180ceca2e0f9f72bf` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:18.383550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f252c786c3d541c180ceca2e0f9f72bf)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:18.388353 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:18.390756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb1124-9a0c-4ded-b664-d8657fd4bdfb None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:18.393836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6ddb1124-9a0c-4ded-b664-d8657fd4bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:18.481916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f252c786c3d541c180ceca2e0f9f72bf'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:18.493923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f252c786c3d541c180ceca2e0f9f72bf'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:18.495085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f252c786c3d541c180ceca2e0f9f72bf'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:18.497755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb1124-9a0c-4ded-b664-d8657fd4bdfb None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:18.505128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f098a-d3fb-4fce-b6b1-b1f55e79f47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:18.506370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f098a-d3fb-4fce-b6b1-b1f55e79f47d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:18.506820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f098a-d3fb-4fce-b6b1-b1f55e79f47d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:18.507312 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f098a-d3fb-4fce-b6b1-b1f55e79f47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:18.507494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f252c786c3d541c180ceca2e0f9f72bf'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:18.524498 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f098a-d3fb-4fce-b6b1-b1f55e79f47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:18.527128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f098a-d3fb-4fce-b6b1-b1f55e79f47d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:18.527300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6ad30b7c-e5f5-4e99-9bfd-b0e8df706cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f252c786c3d541c180ceca2e0f9f72bf'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:18.536131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1090/2163] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:18 2022] DELETE /identity/v3/users/f252c786c3d541c180ceca2e0f9f72bf => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:18.541670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb471838-5904-4fc5-98da-dafb3b73f3da None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:18.542128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb471838-5904-4fc5-98da-dafb3b73f3da None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:18.542652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb471838-5904-4fc5-98da-dafb3b73f3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:18.546288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1074/2164] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:27:18.564644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-bb471838-5904-4fc5-98da-dafb3b73f3da None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:18.566471 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-bb471838-5904-4fc5-98da-dafb3b73f3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:18.646248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1091/2165] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:27:18.661421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f098a-d3fb-4fce-b6b1-b1f55e79f47d service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:18.664748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-668f098a-d3fb-4fce-b6b1-b1f55e79f47d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:18.680180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f098a-d3fb-4fce-b6b1-b1f55e79f47d service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:18.768044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb70e12-4937-4bd3-9496-3d6a9dd63cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:18.770041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb70e12-4937-4bd3-9496-3d6a9dd63cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:18.771020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb70e12-4937-4bd3-9496-3d6a9dd63cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:18.771974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb70e12-4937-4bd3-9496-3d6a9dd63cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:18.795318 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb70e12-4937-4bd3-9496-3d6a9dd63cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:18.798047 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb70e12-4937-4bd3-9496-3d6a9dd63cd6 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:18.817007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1075/2166] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:19.256276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb471838-5904-4fc5-98da-dafb3b73f3da None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:19.258553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-bb471838-5904-4fc5-98da-dafb3b73f3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:19.275434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb471838-5904-4fc5-98da-dafb3b73f3da None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:19.283231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:19.292036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:19.292329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:19.292588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] PATH_INFO: `/v3/projects/98168d53c3604321bf616b373972d0fa` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:19.302943 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98168d53c3604321bf616b373972d0fa)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:19.307395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:19.398207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98168d53c3604321bf616b373972d0fa', 'request_id': 'req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.406396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98168d53c3604321bf616b373972d0fa', 'request_id': 'req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.413581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98168d53c3604321bf616b373972d0fa', 'request_id': 'req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.431458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] The token cache is being invalidate because project 98168d53c3604321bf616b373972d0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:19.431730 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.432260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.434273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1092/2167] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:19 2022] DELETE /identity/v3/projects/98168d53c3604321bf616b373972d0fa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:19.440100 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb70e12-4937-4bd3-9496-3d6a9dd63cd6 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:19.463786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb70e12-4937-4bd3-9496-3d6a9dd63cd6 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:19.572479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:19.574804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:19.589045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:19.590919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:19.591728 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:19.592526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] PATH_INFO: `/v3/users/22320a33b4c84dd18e5e91b74d618073` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:19.596178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22320a33b4c84dd18e5e91b74d618073)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:19.601114 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:19.684880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22320a33b4c84dd18e5e91b74d618073'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.696222 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22320a33b4c84dd18e5e91b74d618073'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.704793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaffa3c-2a0e-4326-879e-91b15a5a8ee1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:19.711764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22320a33b4c84dd18e5e91b74d618073'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.712614 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22320a33b4c84dd18e5e91b74d618073'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.715899 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:19.717619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:19.718273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:19.718947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] PATH_INFO: `/v3/projects/bb675562301f4fda9862f03daef5ac85` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:19.722183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb675562301f4fda9862f03daef5ac85)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:19.727167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:19.729258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22320a33b4c84dd18e5e91b74d618073'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.739981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1076/2168] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:19 2022] DELETE /identity/v3/users/22320a33b4c84dd18e5e91b74d618073 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:19.817412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb675562301f4fda9862f03daef5ac85', 'request_id': 'req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.829721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb675562301f4fda9862f03daef5ac85', 'request_id': 'req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.842080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb675562301f4fda9862f03daef5ac85', 'request_id': 'req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.865483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] The token cache is being invalidate because project bb675562301f4fda9862f03daef5ac85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:19.865845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.866466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:19.873193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1093/2169] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:19 2022] DELETE /identity/v3/projects/bb675562301f4fda9862f03daef5ac85 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:19.874570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:19.876118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:19.968077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc72d2-5d25-4c38-bacc-cd5301e4e51f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:20.073439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:20.075138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:20.075703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:20.076225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] PATH_INFO: `/v3/users/a1b8b957f3e64e10b4c908fa6d681387` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:20.078685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b8b957f3e64e10b4c908fa6d681387)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:20.081201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:20.166095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b8b957f3e64e10b4c908fa6d681387'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.182693 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b8b957f3e64e10b4c908fa6d681387'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.209390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b8b957f3e64e10b4c908fa6d681387'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.210727 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b8b957f3e64e10b4c908fa6d681387'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.224553 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b8b957f3e64e10b4c908fa6d681387'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.234585 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1077/2170] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:19 2022] DELETE /identity/v3/users/a1b8b957f3e64e10b4c908fa6d681387 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:20.571745 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:20.574439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:20.599864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e2cdd-6153-4e59-9551-a9ae7cbaca93 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:20.639467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:20.641289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:20.745829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:20.747174 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:20.747451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:20.747721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] PATH_INFO: `/v3/users/5650be995fdb43c9ab03149fdf5f9758` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:20.750687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5650be995fdb43c9ab03149fdf5f9758)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:20.759089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:20.773327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8254c7-dac2-48c6-be36-4805053fe134 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:20.779017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:20.779998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:20.780716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:20.780716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] PATH_INFO: `/v3/projects/d6f30491243843db88f7de477b0e5a80` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:20.782060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f30491243843db88f7de477b0e5a80)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:20.784121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:20.841587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5650be995fdb43c9ab03149fdf5f9758'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.853904 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5650be995fdb43c9ab03149fdf5f9758'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.855221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5650be995fdb43c9ab03149fdf5f9758'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.863214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f30491243843db88f7de477b0e5a80', 'request_id': 'req-b22db1be-24a6-4d9f-8400-226d32dc33a2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.865201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5650be995fdb43c9ab03149fdf5f9758'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.881829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f30491243843db88f7de477b0e5a80', 'request_id': 'req-b22db1be-24a6-4d9f-8400-226d32dc33a2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.889637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5650be995fdb43c9ab03149fdf5f9758'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.890033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f30491243843db88f7de477b0e5a80', 'request_id': 'req-b22db1be-24a6-4d9f-8400-226d32dc33a2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.903009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1094/2171] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:20 2022] DELETE /identity/v3/users/5650be995fdb43c9ab03149fdf5f9758 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:20.904731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:20.907254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:20.914864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] The token cache is being invalidate because project d6f30491243843db88f7de477b0e5a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:20.915372 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.919128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b22db1be-24a6-4d9f-8400-226d32dc33a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:20.932209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1078/2172] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:20 2022] DELETE /identity/v3/projects/d6f30491243843db88f7de477b0e5a80 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:20.932209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52ec0-5ff9-4aa9-929f-8cd5ed886206 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:20.932209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52ec0-5ff9-4aa9-929f-8cd5ed886206 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:20.932209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52ec0-5ff9-4aa9-929f-8cd5ed886206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:20.964203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f5b52ec0-5ff9-4aa9-929f-8cd5ed886206 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:20.964940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f5b52ec0-5ff9-4aa9-929f-8cd5ed886206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:21.018743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cb6df-c97b-4337-a789-dd607c8843ae admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.027574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.029223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.029785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.030399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] PATH_INFO: `/v3/projects/72e6f143ed304f82b7e927578dcd9dbd` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.032753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e6f143ed304f82b7e927578dcd9dbd)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.038192 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.064659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1079/2173] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:21.070552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c9fde-2775-4013-8b57-dae2d11da04e None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.070552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c9fde-2775-4013-8b57-dae2d11da04e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.070552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c9fde-2775-4013-8b57-dae2d11da04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.098300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3d2c9fde-2775-4013-8b57-dae2d11da04e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:21.099706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3d2c9fde-2775-4013-8b57-dae2d11da04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:21.111826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e6f143ed304f82b7e927578dcd9dbd', 'request_id': 'req-42ad7d6a-22ca-439e-896c-1e11cb90013f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:21.128204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e6f143ed304f82b7e927578dcd9dbd', 'request_id': 'req-42ad7d6a-22ca-439e-896c-1e11cb90013f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:21.139197 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e6f143ed304f82b7e927578dcd9dbd', 'request_id': 'req-42ad7d6a-22ca-439e-896c-1e11cb90013f'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:21.162439 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] The token cache is being invalidate because project 72e6f143ed304f82b7e927578dcd9dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:21.163133 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:21.164120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:21.166913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1095/2174] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:20 2022] DELETE /identity/v3/projects/72e6f143ed304f82b7e927578dcd9dbd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:21.168375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.170728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:21.213370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1080/2175] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:21.213370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a4b1d-7d55-4cd4-ad81-8cc4eb5fe303 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.213370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a4b1d-7d55-4cd4-ad81-8cc4eb5fe303 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.213370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a4b1d-7d55-4cd4-ad81-8cc4eb5fe303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.245382 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6b4a4b1d-7d55-4cd4-ad81-8cc4eb5fe303 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:21.246633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6b4a4b1d-7d55-4cd4-ad81-8cc4eb5fe303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:21.254551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7d6a-22ca-439e-896c-1e11cb90013f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.260798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee0219-683f-45b0-aa46-938e143d0173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.262018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0219-683f-45b0-aa46-938e143d0173 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.262389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1081/2176] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:21.264422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a75ec-60aa-47f5-843a-65885b89a51d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.264862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a75ec-60aa-47f5-843a-65885b89a51d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.265281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a75ec-60aa-47f5-843a-65885b89a51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.269950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0219-683f-45b0-aa46-938e143d0173 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.270515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee0219-683f-45b0-aa46-938e143d0173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.273637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5bee0219-683f-45b0-aa46-938e143d0173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:21.293006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-149a75ec-60aa-47f5-843a-65885b89a51d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:21.295090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-149a75ec-60aa-47f5-843a-65885b89a51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:21.295608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee0219-683f-45b0-aa46-938e143d0173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.299799 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee0219-683f-45b0-aa46-938e143d0173 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.309420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1082/2177] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:21.311580 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697381-ff17-4ab5-a8c1-041887fe8621 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.313109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697381-ff17-4ab5-a8c1-041887fe8621 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.313109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697381-ff17-4ab5-a8c1-041887fe8621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.327143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1096/2178] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:21.329339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee0219-683f-45b0-aa46-938e143d0173 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.347137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-40697381-ff17-4ab5-a8c1-041887fe8621 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:21.349588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-40697381-ff17-4ab5-a8c1-041887fe8621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:21.354383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee0219-683f-45b0-aa46-938e143d0173 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.362203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1083/2179] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:21.365365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ec4c1-1e4d-418a-8088-a99031cea1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.366946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ec4c1-1e4d-418a-8088-a99031cea1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.367517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ec4c1-1e4d-418a-8088-a99031cea1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.367873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697381-ff17-4ab5-a8c1-041887fe8621 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.368156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ec4c1-1e4d-418a-8088-a99031cea1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.370576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ec4c1-1e4d-418a-8088-a99031cea1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:27:21.371251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ec4c1-1e4d-418a-8088-a99031cea1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.376222 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ec4c1-1e4d-418a-8088-a99031cea1e5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.381832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697381-ff17-4ab5-a8c1-041887fe8621 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.390581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5f93f-7350-408e-b905-912cbd67d4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.391313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5f93f-7350-408e-b905-912cbd67d4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.391737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5f93f-7350-408e-b905-912cbd67d4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.392032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5f93f-7350-408e-b905-912cbd67d4d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.393549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5f93f-7350-408e-b905-912cbd67d4d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:27:21.393940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5f93f-7350-408e-b905-912cbd67d4d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.395881 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5f93f-7350-408e-b905-912cbd67d4d5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.406605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1097/2180] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:27:21.407688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ec4c1-1e4d-418a-8088-a99031cea1e5 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.417987 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1084/2181] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:27:21.419204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5f93f-7350-408e-b905-912cbd67d4d5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.425659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ec4c1-1e4d-418a-8088-a99031cea1e5 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.440121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5f93f-7350-408e-b905-912cbd67d4d5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.452102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8776e3-85b9-4fba-a42a-e1f2e298ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.452102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8776e3-85b9-4fba-a42a-e1f2e298ef58 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.452102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8776e3-85b9-4fba-a42a-e1f2e298ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.452102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8776e3-85b9-4fba-a42a-e1f2e298ef58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.452539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75ccc7-319a-495e-bfa7-c44af39e00d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.452626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8776e3-85b9-4fba-a42a-e1f2e298ef58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.452696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75ccc7-319a-495e-bfa7-c44af39e00d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.452696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75ccc7-319a-495e-bfa7-c44af39e00d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.452696 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75ccc7-319a-495e-bfa7-c44af39e00d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.452897 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8776e3-85b9-4fba-a42a-e1f2e298ef58 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.452967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75ccc7-319a-495e-bfa7-c44af39e00d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.454940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75ccc7-319a-495e-bfa7-c44af39e00d4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.488847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1098/2182] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:21 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:21.494744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8776e3-85b9-4fba-a42a-e1f2e298ef58 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.504656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1085/2183] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:21 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:21.511510 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75ccc7-319a-495e-bfa7-c44af39e00d4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.607835 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8776e3-85b9-4fba-a42a-e1f2e298ef58 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.615126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818ae35-de1f-4fc8-9e13-e9356e377251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.616165 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818ae35-de1f-4fc8-9e13-e9356e377251 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.616565 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818ae35-de1f-4fc8-9e13-e9356e377251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.616983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818ae35-de1f-4fc8-9e13-e9356e377251 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.618171 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818ae35-de1f-4fc8-9e13-e9356e377251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.622604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818ae35-de1f-4fc8-9e13-e9356e377251 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.647612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75ccc7-319a-495e-bfa7-c44af39e00d4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.656185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c170f44-5b18-4639-b205-76cd7ffbefc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.658467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c170f44-5b18-4639-b205-76cd7ffbefc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.658969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c170f44-5b18-4639-b205-76cd7ffbefc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.659490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c170f44-5b18-4639-b205-76cd7ffbefc7 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.660718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c170f44-5b18-4639-b205-76cd7ffbefc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.666581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1099/2184] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:21 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:21.666832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c170f44-5b18-4639-b205-76cd7ffbefc7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.668502 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818ae35-de1f-4fc8-9e13-e9356e377251 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.683426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818ae35-de1f-4fc8-9e13-e9356e377251 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.692065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d722ac0-88f1-4b5f-a27a-29ad334a8257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.694240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d722ac0-88f1-4b5f-a27a-29ad334a8257 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.694240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d722ac0-88f1-4b5f-a27a-29ad334a8257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.694240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d722ac0-88f1-4b5f-a27a-29ad334a8257 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.695171 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d722ac0-88f1-4b5f-a27a-29ad334a8257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.698210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d722ac0-88f1-4b5f-a27a-29ad334a8257 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.699443 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1086/2185] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:21 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:27:21.704103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c170f44-5b18-4639-b205-76cd7ffbefc7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.710483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1100/2186] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:21.715626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d722ac0-88f1-4b5f-a27a-29ad334a8257 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.718760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c170f44-5b18-4639-b205-76cd7ffbefc7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.725767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252c85c-9215-441c-837d-4fd2ff3bee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.726804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252c85c-9215-441c-837d-4fd2ff3bee79 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.727171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252c85c-9215-441c-837d-4fd2ff3bee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.727527 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252c85c-9215-441c-837d-4fd2ff3bee79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.728546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252c85c-9215-441c-837d-4fd2ff3bee79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.730753 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252c85c-9215-441c-837d-4fd2ff3bee79 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.731375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d722ac0-88f1-4b5f-a27a-29ad334a8257 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.738832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816093a8-06f5-4f33-8e85-89f9db531898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.739538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816093a8-06f5-4f33-8e85-89f9db531898 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.739817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816093a8-06f5-4f33-8e85-89f9db531898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.740248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816093a8-06f5-4f33-8e85-89f9db531898 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.740836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816093a8-06f5-4f33-8e85-89f9db531898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.742858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816093a8-06f5-4f33-8e85-89f9db531898 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.745281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1087/2187] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:27:21.751728 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252c85c-9215-441c-837d-4fd2ff3bee79 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.764407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1101/2188] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:27:21.765410 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816093a8-06f5-4f33-8e85-89f9db531898 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.766596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252c85c-9215-441c-837d-4fd2ff3bee79 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.772526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439a88b-da39-4937-aac5-3b9330500106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.772526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439a88b-da39-4937-aac5-3b9330500106 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.772966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439a88b-da39-4937-aac5-3b9330500106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.773117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439a88b-da39-4937-aac5-3b9330500106 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.773814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439a88b-da39-4937-aac5-3b9330500106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.775623 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439a88b-da39-4937-aac5-3b9330500106 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.783641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816093a8-06f5-4f33-8e85-89f9db531898 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.789564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1709de5-40f0-46b5-8cc9-168f8d743494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.790752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1709de5-40f0-46b5-8cc9-168f8d743494 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.791255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1709de5-40f0-46b5-8cc9-168f8d743494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.791689 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1709de5-40f0-46b5-8cc9-168f8d743494 admin admin] PATH_INFO: `/v3/projects/edbec93168cd4e45a0afecae891a4f8f/users/621d72e0b63e4eeba1251cef77e133d3/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.793420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1088/2189] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:27:21.794618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439a88b-da39-4937-aac5-3b9330500106 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.809748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439a88b-da39-4937-aac5-3b9330500106 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:21.819061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459560e-19b3-4112-ad9e-71e675c99ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:21.821294 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459560e-19b3-4112-ad9e-71e675c99ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.821778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459560e-19b3-4112-ad9e-71e675c99ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.822030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459560e-19b3-4112-ad9e-71e675c99ca7 admin admin] PATH_INFO: `/v3/projects/73802ea8e00446928c5108b4a7805c2a/users/e6bb7d36496d439780ce09aec27b5724/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.823171 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1709de5-40f0-46b5-8cc9-168f8d743494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbec93168cd4e45a0afecae891a4f8f, user_id=621d72e0b63e4eeba1251cef77e133d3, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.829833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1709de5-40f0-46b5-8cc9-168f8d743494 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.850672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459560e-19b3-4112-ad9e-71e675c99ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73802ea8e00446928c5108b4a7805c2a, user_id=e6bb7d36496d439780ce09aec27b5724, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:21.854219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1102/2190] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:21 2022] PUT /identity/v3/projects/edbec93168cd4e45a0afecae891a4f8f/users/621d72e0b63e4eeba1251cef77e133d3/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:21.855550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1709de5-40f0-46b5-8cc9-168f8d743494 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:21.856378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459560e-19b3-4112-ad9e-71e675c99ca7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:21.857389 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f1709de5-40f0-46b5-8cc9-168f8d743494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:21.880856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1089/2191] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:21 2022] PUT /identity/v3/projects/73802ea8e00446928c5108b4a7805c2a/users/e6bb7d36496d439780ce09aec27b5724/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:21.882330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc47b-6e73-43b4-8238-42f0e3109716 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:21.882820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc47b-6e73-43b4-8238-42f0e3109716 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:21.883363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc47b-6e73-43b4-8238-42f0e3109716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:21.916669 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-845dc47b-6e73-43b4-8238-42f0e3109716 None None] MFA Rules not processed for user `621d72e0b63e4eeba1251cef77e133d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:21.918422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-845dc47b-6e73-43b4-8238-42f0e3109716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:21.985630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1709de5-40f0-46b5-8cc9-168f8d743494 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.003391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1090/2192] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:22.004903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20c19-fbaf-418d-be63-26da4cdc7f65 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.005191 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20c19-fbaf-418d-be63-26da4cdc7f65 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.005495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20c19-fbaf-418d-be63-26da4cdc7f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.046997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-bfb20c19-fbaf-418d-be63-26da4cdc7f65 None None] MFA Rules not processed for user `e6bb7d36496d439780ce09aec27b5724`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:22.048968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bfb20c19-fbaf-418d-be63-26da4cdc7f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:22.100673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.102272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.102754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.103225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] PATH_INFO: `/v3/projects/6263c4e9b32046e78a33e462028c5460` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.105800 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6263c4e9b32046e78a33e462028c5460)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.109590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.182813 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6263c4e9b32046e78a33e462028c5460', 'request_id': 'req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:22.190593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6263c4e9b32046e78a33e462028c5460', 'request_id': 'req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:22.193351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1091/2193] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:22.195137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb20c19-fbaf-418d-be63-26da4cdc7f65 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.213273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6263c4e9b32046e78a33e462028c5460', 'request_id': 'req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:22.217179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb20c19-fbaf-418d-be63-26da4cdc7f65 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.217792 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] The token cache is being invalidate because project 6263c4e9b32046e78a33e462028c5460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:22.218241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:22.219083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:22.221325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1103/2194] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:21 2022] DELETE /identity/v3/projects/6263c4e9b32046e78a33e462028c5460 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:22.221914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.223612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:22.299471 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aa19a-d6f9-4c9d-a1fa-5ea63c27bf9a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.304617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272262d-87c9-4f32-b0a0-f917080fe894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.305331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272262d-87c9-4f32-b0a0-f917080fe894 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.305608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272262d-87c9-4f32-b0a0-f917080fe894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.305878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272262d-87c9-4f32-b0a0-f917080fe894 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.306923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272262d-87c9-4f32-b0a0-f917080fe894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.308598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272262d-87c9-4f32-b0a0-f917080fe894 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.316831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4fb09-359f-4d37-b069-884e60dc7030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.318033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4fb09-359f-4d37-b069-884e60dc7030 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.318531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4fb09-359f-4d37-b069-884e60dc7030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.319019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4fb09-359f-4d37-b069-884e60dc7030 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.320418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4fb09-359f-4d37-b069-884e60dc7030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.326870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4fb09-359f-4d37-b069-884e60dc7030 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.344892 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1104/2195] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:22 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:22.347450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a34045-1b27-44d0-af73-def0f6c12459 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.347944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a34045-1b27-44d0-af73-def0f6c12459 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.348421 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a34045-1b27-44d0-af73-def0f6c12459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.357704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1092/2196] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:22 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:22.358560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4fb09-359f-4d37-b069-884e60dc7030 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.383300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-63a34045-1b27-44d0-af73-def0f6c12459 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:22.388925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-63a34045-1b27-44d0-af73-def0f6c12459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:22.450523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4fb09-359f-4d37-b069-884e60dc7030 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.458811 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0685f8-3f8b-43e0-a479-b645e0686b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.460211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0685f8-3f8b-43e0-a479-b645e0686b2a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.460664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0685f8-3f8b-43e0-a479-b645e0686b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.461139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0685f8-3f8b-43e0-a479-b645e0686b2a admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.462518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0685f8-3f8b-43e0-a479-b645e0686b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.465585 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0685f8-3f8b-43e0-a479-b645e0686b2a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.491592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1105/2197] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:22.492662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a34045-1b27-44d0-af73-def0f6c12459 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.494214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-63a34045-1b27-44d0-af73-def0f6c12459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:22.500817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1093/2198] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:22 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:22.503814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523256b5-8f58-48d4-bbd6-fd0286e5f317 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.504348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523256b5-8f58-48d4-bbd6-fd0286e5f317 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.504763 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523256b5-8f58-48d4-bbd6-fd0286e5f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.508782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a34045-1b27-44d0-af73-def0f6c12459 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.514157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75dbf1-0b12-49f2-b9ef-0f74c9fc2467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.515176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75dbf1-0b12-49f2-b9ef-0f74c9fc2467 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.515522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75dbf1-0b12-49f2-b9ef-0f74c9fc2467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.515866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75dbf1-0b12-49f2-b9ef-0f74c9fc2467 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.516780 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75dbf1-0b12-49f2-b9ef-0f74c9fc2467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.518989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75dbf1-0b12-49f2-b9ef-0f74c9fc2467 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.526279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-523256b5-8f58-48d4-bbd6-fd0286e5f317 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:22.527534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-523256b5-8f58-48d4-bbd6-fd0286e5f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:22.538678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1094/2199] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:22.540868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523256b5-8f58-48d4-bbd6-fd0286e5f317 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.558847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1106/2200] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:22 2022] POST /identity/v3/users => generated 300 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:22.559093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523256b5-8f58-48d4-bbd6-fd0286e5f317 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.559178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75dbf1-0b12-49f2-b9ef-0f74c9fc2467 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.567978 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a110b-157b-4fb9-a87e-3ca2ca781e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.568710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a110b-157b-4fb9-a87e-3ca2ca781e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.569065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a110b-157b-4fb9-a87e-3ca2ca781e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.569446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a110b-157b-4fb9-a87e-3ca2ca781e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.570506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a110b-157b-4fb9-a87e-3ca2ca781e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.572914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a110b-157b-4fb9-a87e-3ca2ca781e56 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.577367 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75dbf1-0b12-49f2-b9ef-0f74c9fc2467 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.588676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1095/2201] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:22.589714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8b7b-3560-4a3e-a5f6-410403f0c5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.591345 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8b7b-3560-4a3e-a5f6-410403f0c5bc admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.591927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8b7b-3560-4a3e-a5f6-410403f0c5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.592884 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8b7b-3560-4a3e-a5f6-410403f0c5bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.594056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a110b-157b-4fb9-a87e-3ca2ca781e56 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.594776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae8b7b-3560-4a3e-a5f6-410403f0c5bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:27:22.595567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae8b7b-3560-4a3e-a5f6-410403f0c5bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.599036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae8b7b-3560-4a3e-a5f6-410403f0c5bc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.607137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a110b-157b-4fb9-a87e-3ca2ca781e56 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.612863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ffa12-5667-4d0d-ad35-5498937e1e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.613631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ffa12-5667-4d0d-ad35-5498937e1e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.613916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ffa12-5667-4d0d-ad35-5498937e1e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.614230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ffa12-5667-4d0d-ad35-5498937e1e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.615405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ffa12-5667-4d0d-ad35-5498937e1e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.617203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ffa12-5667-4d0d-ad35-5498937e1e6e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.633214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1107/2202] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:27:22.640174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1096/2203] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:22.640174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ffa12-5667-4d0d-ad35-5498937e1e6e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.640440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8b7b-3560-4a3e-a5f6-410403f0c5bc admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.650648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8b7b-3560-4a3e-a5f6-410403f0c5bc admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.651005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ffa12-5667-4d0d-ad35-5498937e1e6e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.656970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5b81-6c58-4d32-af16-4e24d46b5739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.657280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea47db9-3244-40c2-987f-3e85350ea76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.657938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea47db9-3244-40c2-987f-3e85350ea76d admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.658282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea47db9-3244-40c2-987f-3e85350ea76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.658456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5b81-6c58-4d32-af16-4e24d46b5739 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.658685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea47db9-3244-40c2-987f-3e85350ea76d admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.658856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5b81-6c58-4d32-af16-4e24d46b5739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.659091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5b81-6c58-4d32-af16-4e24d46b5739 admin admin] PATH_INFO: `/v3/projects/448f774b12c64645bce16badaba716c4/users/f3a501e7c27e42a98312854210918b0d/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.659590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea47db9-3244-40c2-987f-3e85350ea76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.662061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea47db9-3244-40c2-987f-3e85350ea76d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.680560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d5b81-6c58-4d32-af16-4e24d46b5739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448f774b12c64645bce16badaba716c4, user_id=f3a501e7c27e42a98312854210918b0d, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.686350 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d5b81-6c58-4d32-af16-4e24d46b5739 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.708243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1108/2204] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:22 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:22.709653 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1097/2205] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:22 2022] PUT /identity/v3/projects/448f774b12c64645bce16badaba716c4/users/f3a501e7c27e42a98312854210918b0d/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:22.711117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5b81-6c58-4d32-af16-4e24d46b5739 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.714411 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea47db9-3244-40c2-987f-3e85350ea76d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.808077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5b81-6c58-4d32-af16-4e24d46b5739 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.808351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea47db9-3244-40c2-987f-3e85350ea76d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.815922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a75ca-91e4-4710-9a1e-e1470d9dea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.816636 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a75ca-91e4-4710-9a1e-e1470d9dea7a admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.816937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a75ca-91e4-4710-9a1e-e1470d9dea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.817270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a75ca-91e4-4710-9a1e-e1470d9dea7a admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.817428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d76988-71e4-44b4-bf0b-2fe2a5993dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.818042 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a75ca-91e4-4710-9a1e-e1470d9dea7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.818542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76988-71e4-44b4-bf0b-2fe2a5993dff admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.818870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76988-71e4-44b4-bf0b-2fe2a5993dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.819219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76988-71e4-44b4-bf0b-2fe2a5993dff admin admin] PATH_INFO: `/v3/projects/6bc0010b8e7d451ea0d8933efcee5165/users/26745424b0a74578837ed4c7b2f432ab/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.820135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a75ca-91e4-4710-9a1e-e1470d9dea7a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.841847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d76988-71e4-44b4-bf0b-2fe2a5993dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc0010b8e7d451ea0d8933efcee5165, user_id=26745424b0a74578837ed4c7b2f432ab, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.846765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d76988-71e4-44b4-bf0b-2fe2a5993dff admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.849317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1109/2206] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:22 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:22.852806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a75ca-91e4-4710-9a1e-e1470d9dea7a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.868950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a75ca-91e4-4710-9a1e-e1470d9dea7a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.870063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1098/2207] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:22 2022] PUT /identity/v3/projects/6bc0010b8e7d451ea0d8933efcee5165/users/26745424b0a74578837ed4c7b2f432ab/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:22.871609 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d76988-71e4-44b4-bf0b-2fe2a5993dff admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.959550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b113a-083f-4b04-a760-82ed32e8756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.960764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b113a-083f-4b04-a760-82ed32e8756c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.961452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b113a-083f-4b04-a760-82ed32e8756c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.962080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b113a-083f-4b04-a760-82ed32e8756c admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.963611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b113a-083f-4b04-a760-82ed32e8756c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.966847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b113a-083f-4b04-a760-82ed32e8756c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.968997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d76988-71e4-44b4-bf0b-2fe2a5993dff admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:22.975534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a17be4-3406-4495-b24c-860202a7d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:22.976295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a17be4-3406-4495-b24c-860202a7d609 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:22.976577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a17be4-3406-4495-b24c-860202a7d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:22.976892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a17be4-3406-4495-b24c-860202a7d609 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:22.977703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a17be4-3406-4495-b24c-860202a7d609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:22.979385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a17be4-3406-4495-b24c-860202a7d609 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:22.987344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1110/2208] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:22.988476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b113a-083f-4b04-a760-82ed32e8756c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:22.993389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1099/2209] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:22.995222 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a17be4-3406-4495-b24c-860202a7d609 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:23.002028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b113a-083f-4b04-a760-82ed32e8756c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:23.008153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a17be4-3406-4495-b24c-860202a7d609 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:23.009195 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6a8a-89ba-4b25-a6e6-f5e1bd684e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:23.010098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6a8a-89ba-4b25-a6e6-f5e1bd684e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.010377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6a8a-89ba-4b25-a6e6-f5e1bd684e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.010650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f6a8a-89ba-4b25-a6e6-f5e1bd684e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.011400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6a8a-89ba-4b25-a6e6-f5e1bd684e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:23.013282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f6a8a-89ba-4b25-a6e6-f5e1bd684e23 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:23.016967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4261-5fa7-46b4-a900-1f0bc45c5880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:23.018565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4261-5fa7-46b4-a900-1f0bc45c5880 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.019129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4261-5fa7-46b4-a900-1f0bc45c5880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.020425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4261-5fa7-46b4-a900-1f0bc45c5880 admin admin] PATH_INFO: `/v3/projects/448f774b12c64645bce16badaba716c4/users/f3a501e7c27e42a98312854210918b0d/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.022794 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f4261-5fa7-46b4-a900-1f0bc45c5880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448f774b12c64645bce16badaba716c4, user_id=f3a501e7c27e42a98312854210918b0d, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:23.026629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1111/2210] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:23.028308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f4261-5fa7-46b4-a900-1f0bc45c5880 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:23.028938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6a8a-89ba-4b25-a6e6-f5e1bd684e23 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:23.043347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f6a8a-89ba-4b25-a6e6-f5e1bd684e23 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:23.051702 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1100/2211] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:22 2022] PUT /identity/v3/projects/448f774b12c64645bce16badaba716c4/users/f3a501e7c27e42a98312854210918b0d/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:23.053591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4261-5fa7-46b4-a900-1f0bc45c5880 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:23.140272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf06d3-f696-4ca2-ba8a-113588c8266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:23.141063 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf06d3-f696-4ca2-ba8a-113588c8266e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.141364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf06d3-f696-4ca2-ba8a-113588c8266e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.141642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf06d3-f696-4ca2-ba8a-113588c8266e admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.142393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf06d3-f696-4ca2-ba8a-113588c8266e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:23.144095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf06d3-f696-4ca2-ba8a-113588c8266e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:23.157841 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1112/2212] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:23.159179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd207-510d-410b-a8d2-f735c7fd441d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.159466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd207-510d-410b-a8d2-f735c7fd441d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.159734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd207-510d-410b-a8d2-f735c7fd441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.167483 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4261-5fa7-46b4-a900-1f0bc45c5880 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:23.173175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33f45-257e-4735-8523-ccc41f5696f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:23.174341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33f45-257e-4735-8523-ccc41f5696f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.174705 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33f45-257e-4735-8523-ccc41f5696f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.175048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac33f45-257e-4735-8523-ccc41f5696f8 admin admin] PATH_INFO: `/v3/projects/6bc0010b8e7d451ea0d8933efcee5165/users/26745424b0a74578837ed4c7b2f432ab/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.177304 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac33f45-257e-4735-8523-ccc41f5696f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc0010b8e7d451ea0d8933efcee5165, user_id=26745424b0a74578837ed4c7b2f432ab, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:23.181117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac33f45-257e-4735-8523-ccc41f5696f8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:23.195413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1101/2213] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:23 2022] PUT /identity/v3/projects/6bc0010b8e7d451ea0d8933efcee5165/users/26745424b0a74578837ed4c7b2f432ab/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:23.197990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33f45-257e-4735-8523-ccc41f5696f8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:23.219261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-8d4cd207-510d-410b-a8d2-f735c7fd441d None None] MFA Rules not processed for user `f3a501e7c27e42a98312854210918b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:23.220862 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8d4cd207-510d-410b-a8d2-f735c7fd441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:23.344147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac33f45-257e-4735-8523-ccc41f5696f8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:23.352662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf35d5b-aca6-4c25-b318-9cbd63b2cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:23.354202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35d5b-aca6-4c25-b318-9cbd63b2cac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.354680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35d5b-aca6-4c25-b318-9cbd63b2cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.355159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf35d5b-aca6-4c25-b318-9cbd63b2cac3 admin admin] PATH_INFO: `/v3/projects/12da7c52708b49e8827fb30ea43f8e4d/users/6b11396acc67415abb08ddddf5680df8/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.361048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1113/2214] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:23.369294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b77f-bc6c-4efe-a479-960b3e3b39ab None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.370113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b77f-bc6c-4efe-a479-960b3e3b39ab None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.370786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010b77f-bc6c-4efe-a479-960b3e3b39ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.375394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf35d5b-aca6-4c25-b318-9cbd63b2cac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12da7c52708b49e8827fb30ea43f8e4d, user_id=6b11396acc67415abb08ddddf5680df8, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:23.378333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf35d5b-aca6-4c25-b318-9cbd63b2cac3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:23.396548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1102/2215] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:23 2022] PUT /identity/v3/projects/12da7c52708b49e8827fb30ea43f8e4d/users/6b11396acc67415abb08ddddf5680df8/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:23.397736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf35d5b-aca6-4c25-b318-9cbd63b2cac3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:23.399738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-eaf35d5b-aca6-4c25-b318-9cbd63b2cac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:23.419973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-0010b77f-bc6c-4efe-a479-960b3e3b39ab None None] MFA Rules not processed for user `26745424b0a74578837ed4c7b2f432ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:23.422064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0010b77f-bc6c-4efe-a479-960b3e3b39ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:23.483612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf35d5b-aca6-4c25-b318-9cbd63b2cac3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:23.488930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:23.489886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.490205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.490378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] PATH_INFO: `/v3/users/d471c27249934edc98ca22f4c49ff99e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.491718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d471c27249934edc98ca22f4c49ff99e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:23.494174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:23.535403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1114/2216] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:23.537009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010b77f-bc6c-4efe-a479-960b3e3b39ab None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:23.539174 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0010b77f-bc6c-4efe-a479-960b3e3b39ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:23.560245 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd471c27249934edc98ca22f4c49ff99e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:23.575633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd471c27249934edc98ca22f4c49ff99e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:23.593262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd471c27249934edc98ca22f4c49ff99e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:23.594410 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd471c27249934edc98ca22f4c49ff99e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:23.606056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-39a52d80-9567-41f2-b036-888fa89040f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd471c27249934edc98ca22f4c49ff99e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:23.616665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1103/2217] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:23 2022] DELETE /identity/v3/users/d471c27249934edc98ca22f4c49ff99e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:23.619249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad308f-85e4-48cf-b81b-5315a43e9a0b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.619624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad308f-85e4-48cf-b81b-5315a43e9a0b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.620082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad308f-85e4-48cf-b81b-5315a43e9a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.641663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010b77f-bc6c-4efe-a479-960b3e3b39ab None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:23.647164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f4ad308f-85e4-48cf-b81b-5315a43e9a0b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:23.648400 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f4ad308f-85e4-48cf-b81b-5315a43e9a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:23.730118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062ad6-3bbf-45bf-99ae-5ba85540efab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:23.731116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062ad6-3bbf-45bf-99ae-5ba85540efab service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.731390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062ad6-3bbf-45bf-99ae-5ba85540efab service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.731834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062ad6-3bbf-45bf-99ae-5ba85540efab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.733965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-05062ad6-3bbf-45bf-99ae-5ba85540efab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:23.742659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1104/2218] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:23.745948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad308f-85e4-48cf-b81b-5315a43e9a0b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:23.754929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f4ad308f-85e4-48cf-b81b-5315a43e9a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:23.776594 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad308f-85e4-48cf-b81b-5315a43e9a0b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:23.781140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426566e7-1049-4b98-8767-2474c650eda9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:23.782017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426566e7-1049-4b98-8767-2474c650eda9 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.782387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426566e7-1049-4b98-8767-2474c650eda9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.782760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426566e7-1049-4b98-8767-2474c650eda9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.785161 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-426566e7-1049-4b98-8767-2474c650eda9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:23.812586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05062ad6-3bbf-45bf-99ae-5ba85540efab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:23.814160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05062ad6-3bbf-45bf-99ae-5ba85540efab service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:23.827818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1115/2219] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:23.829874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e14d-71ea-4108-9d7a-7892ab782a1b None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:23.830332 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e14d-71ea-4108-9d7a-7892ab782a1b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:23.830791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e14d-71ea-4108-9d7a-7892ab782a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:23.860571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-5fc5e14d-71ea-4108-9d7a-7892ab782a1b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:23.862028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5fc5e14d-71ea-4108-9d7a-7892ab782a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:23.872396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1116/2220] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:23.873573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e14d-71ea-4108-9d7a-7892ab782a1b None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:23.887159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5fc5e14d-71ea-4108-9d7a-7892ab782a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:23.901369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426566e7-1049-4b98-8767-2474c650eda9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:23.903671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426566e7-1049-4b98-8767-2474c650eda9 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:23.928629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1105/2221] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:23.930319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426566e7-1049-4b98-8767-2474c650eda9 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:23.933099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-426566e7-1049-4b98-8767-2474c650eda9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:24.028601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e14d-71ea-4108-9d7a-7892ab782a1b None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:24.039257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375132a-e0e0-42c7-b243-c793457b1d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:24.040080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375132a-e0e0-42c7-b243-c793457b1d39 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:24.040521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375132a-e0e0-42c7-b243-c793457b1d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:24.040823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375132a-e0e0-42c7-b243-c793457b1d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:24.048756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426566e7-1049-4b98-8767-2474c650eda9 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:24.052777 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375132a-e0e0-42c7-b243-c793457b1d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:24.054473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375132a-e0e0-42c7-b243-c793457b1d39 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:24.058120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f69697-9f9d-485a-9807-421e3b162c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:24.061121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f69697-9f9d-485a-9807-421e3b162c47 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:24.061659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f69697-9f9d-485a-9807-421e3b162c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:24.062152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f69697-9f9d-485a-9807-421e3b162c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:24.077982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1117/2222] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:24.079093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375132a-e0e0-42c7-b243-c793457b1d39 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:24.081051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9375132a-e0e0-42c7-b243-c793457b1d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:24.081512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f69697-9f9d-485a-9807-421e3b162c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:24.084699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f69697-9f9d-485a-9807-421e3b162c47 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:24.102383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375132a-e0e0-42c7-b243-c793457b1d39 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:24.105865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1106/2223] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:24.112316 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:24.114097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:24.114557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:24.115140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] PATH_INFO: `/v3/users/621d72e0b63e4eeba1251cef77e133d3` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:24.117737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=621d72e0b63e4eeba1251cef77e133d3)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:24.122185 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:24.227823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621d72e0b63e4eeba1251cef77e133d3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:24.246006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621d72e0b63e4eeba1251cef77e133d3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:24.247588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621d72e0b63e4eeba1251cef77e133d3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:24.272604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621d72e0b63e4eeba1251cef77e133d3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:24.302050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621d72e0b63e4eeba1251cef77e133d3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:24.314505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1118/2224] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:24 2022] DELETE /identity/v3/users/621d72e0b63e4eeba1251cef77e133d3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:24.327695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e93779-9c00-466f-8511-419969f46288 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:24.328355 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e93779-9c00-466f-8511-419969f46288 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:24.328928 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e93779-9c00-466f-8511-419969f46288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:24.395114 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d0e93779-9c00-466f-8511-419969f46288 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:24.401986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d0e93779-9c00-466f-8511-419969f46288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:24.534869 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1107/2225] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:24.554637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:24.556977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:24.640782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e93779-9c00-466f-8511-419969f46288 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:24.644890 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d0e93779-9c00-466f-8511-419969f46288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:24.682635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e93779-9c00-466f-8511-419969f46288 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:24.696315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:24.698864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:24.699855 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:24.700637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] PATH_INFO: `/v3/projects/375c328adffb4a249713cab314942fb6` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:24.703301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=375c328adffb4a249713cab314942fb6)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:24.705391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587672e2-26eb-427d-a5f8-8714ba6dac2d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:24.707726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:24.712295 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b48b4f-e070-4273-b618-b252456cd31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:24.713415 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48b4f-e070-4273-b618-b252456cd31d service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:24.713901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48b4f-e070-4273-b618-b252456cd31d service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:24.714319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48b4f-e070-4273-b618-b252456cd31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:24.731604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b48b4f-e070-4273-b618-b252456cd31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:24.734134 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b48b4f-e070-4273-b618-b252456cd31d service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:24.750443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1119/2226] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:24.811365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375c328adffb4a249713cab314942fb6', 'request_id': 'req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:24.824755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375c328adffb4a249713cab314942fb6', 'request_id': 'req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:24.836434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375c328adffb4a249713cab314942fb6', 'request_id': 'req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:24.852939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] The token cache is being invalidate because project 375c328adffb4a249713cab314942fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:24.853658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:24.855412 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ecec2d35-a7bb-4ca4-bebd-b2b3b9b84d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:24.857307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1108/2227] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:24 2022] DELETE /identity/v3/projects/375c328adffb4a249713cab314942fb6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:24.864627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b54e79-c2c6-4012-9780-c87977d9ce6b None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:24.865478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b54e79-c2c6-4012-9780-c87977d9ce6b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:24.866105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b54e79-c2c6-4012-9780-c87977d9ce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:24.897845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-05b54e79-c2c6-4012-9780-c87977d9ce6b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:24.899118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-05b54e79-c2c6-4012-9780-c87977d9ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:25.005797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1120/2228] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:25.016040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec241-ea57-4bdf-a0cd-c8a3c39eaba2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:25.016511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec241-ea57-4bdf-a0cd-c8a3c39eaba2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:25.018157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaec241-ea57-4bdf-a0cd-c8a3c39eaba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:25.067505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-caaec241-ea57-4bdf-a0cd-c8a3c39eaba2 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:25.070054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-caaec241-ea57-4bdf-a0cd-c8a3c39eaba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:25.090301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1109/2229] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:25.096648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b54e79-c2c6-4012-9780-c87977d9ce6b None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:25.116212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b54e79-c2c6-4012-9780-c87977d9ce6b None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:25.124854 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f6307-10bd-43c4-b4ad-0a8c9ab5359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:25.126263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f6307-10bd-43c4-b4ad-0a8c9ab5359e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:25.126745 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f6307-10bd-43c4-b4ad-0a8c9ab5359e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:25.127311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f6307-10bd-43c4-b4ad-0a8c9ab5359e admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:25.128969 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f6307-10bd-43c4-b4ad-0a8c9ab5359e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:27:25.129780 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f6307-10bd-43c4-b4ad-0a8c9ab5359e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:25.133113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f6307-10bd-43c4-b4ad-0a8c9ab5359e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:25.163151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1121/2230] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:27:25.164931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaec241-ea57-4bdf-a0cd-c8a3c39eaba2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:25.184468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaec241-ea57-4bdf-a0cd-c8a3c39eaba2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:25.193381 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ab921-f78e-4f0d-9e5b-abf856777ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:25.196601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab921-f78e-4f0d-9e5b-abf856777ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:25.197356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab921-f78e-4f0d-9e5b-abf856777ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:25.198582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ab921-f78e-4f0d-9e5b-abf856777ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:25.199514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ab921-f78e-4f0d-9e5b-abf856777ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:25.203761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ab921-f78e-4f0d-9e5b-abf856777ff6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:25.245280 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1110/2231] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:25 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:25.250379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f6307-10bd-43c4-b4ad-0a8c9ab5359e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:25.269743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f6307-10bd-43c4-b4ad-0a8c9ab5359e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:25.390731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f86a9-cdc3-42cd-88fc-372efd4e9936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:25.392283 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f86a9-cdc3-42cd-88fc-372efd4e9936 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:25.392974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f86a9-cdc3-42cd-88fc-372efd4e9936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:25.393703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f86a9-cdc3-42cd-88fc-372efd4e9936 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:25.395803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f86a9-cdc3-42cd-88fc-372efd4e9936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:25.400853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f86a9-cdc3-42cd-88fc-372efd4e9936 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:25.439234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1122/2232] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:25 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:27:25.444778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ab921-f78e-4f0d-9e5b-abf856777ff6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:25.469846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ab921-f78e-4f0d-9e5b-abf856777ff6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:25.480597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac9a3f-2dfc-47a1-aff6-f81bf78983c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:25.481838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac9a3f-2dfc-47a1-aff6-f81bf78983c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:25.482621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac9a3f-2dfc-47a1-aff6-f81bf78983c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:25.483292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac9a3f-2dfc-47a1-aff6-f81bf78983c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:25.485394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac9a3f-2dfc-47a1-aff6-f81bf78983c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:25.491077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac9a3f-2dfc-47a1-aff6-f81bf78983c8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:25.525396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1111/2233] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:27:25.527626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f86a9-cdc3-42cd-88fc-372efd4e9936 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:25.554638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f86a9-cdc3-42cd-88fc-372efd4e9936 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:25.578072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed213d-ce12-45b5-9df6-69faf8a1f78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:25.582577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac9a3f-2dfc-47a1-aff6-f81bf78983c8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:25.583942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed213d-ce12-45b5-9df6-69faf8a1f78b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:25.584276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed213d-ce12-45b5-9df6-69faf8a1f78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:25.584625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed213d-ce12-45b5-9df6-69faf8a1f78b admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:25.585711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed213d-ce12-45b5-9df6-69faf8a1f78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:25.587386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed213d-ce12-45b5-9df6-69faf8a1f78b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:25.595439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-67ac9a3f-2dfc-47a1-aff6-f81bf78983c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:25.639180 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac9a3f-2dfc-47a1-aff6-f81bf78983c8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:25.645185 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1123/2234] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:27:25.651548 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed213d-ce12-45b5-9df6-69faf8a1f78b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:25.663455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:25.665306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed213d-ce12-45b5-9df6-69faf8a1f78b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:25.667348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:25.668278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:25.677311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] PATH_INFO: `/v3/projects/edbec93168cd4e45a0afecae891a4f8f` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:25.677311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbec93168cd4e45a0afecae891a4f8f)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:25.677311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:25.686596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b874dfb-5d62-4e71-a54b-c45981f9ce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:25.687519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874dfb-5d62-4e71-a54b-c45981f9ce44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:25.687827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874dfb-5d62-4e71-a54b-c45981f9ce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:25.688296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874dfb-5d62-4e71-a54b-c45981f9ce44 admin admin] PATH_INFO: `/v3/projects/967f60f2af934cdb93fa2baa9baf704c/users/cfdea1465de641c382e0cade871d0c6a/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:25.725806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b874dfb-5d62-4e71-a54b-c45981f9ce44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=967f60f2af934cdb93fa2baa9baf704c, user_id=cfdea1465de641c382e0cade871d0c6a, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:25.729095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b874dfb-5d62-4e71-a54b-c45981f9ce44 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:25.762088 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1124/2235] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:25 2022] PUT /identity/v3/projects/967f60f2af934cdb93fa2baa9baf704c/users/cfdea1465de641c382e0cade871d0c6a/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:25.775598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734b8b-c876-4c35-8f69-3c27f997bb74 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:25.775842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734b8b-c876-4c35-8f69-3c27f997bb74 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:25.776180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40734b8b-c876-4c35-8f69-3c27f997bb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:25.783307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbec93168cd4e45a0afecae891a4f8f', 'request_id': 'req-ded3b6bd-986d-48ba-b93f-6b5776c757a0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:25.805815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbec93168cd4e45a0afecae891a4f8f', 'request_id': 'req-ded3b6bd-986d-48ba-b93f-6b5776c757a0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:25.819282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbec93168cd4e45a0afecae891a4f8f', 'request_id': 'req-ded3b6bd-986d-48ba-b93f-6b5776c757a0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:25.840853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-40734b8b-c876-4c35-8f69-3c27f997bb74 None None] MFA Rules not processed for user `cfdea1465de641c382e0cade871d0c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:25.845390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-40734b8b-c876-4c35-8f69-3c27f997bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:25.861325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] The token cache is being invalidate because project edbec93168cd4e45a0afecae891a4f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:25.862488 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:25.866043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:25.877451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1112/2236] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:25 2022] DELETE /identity/v3/projects/edbec93168cd4e45a0afecae891a4f8f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:25.880793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:25.893600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:26.086224 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3b6bd-986d-48ba-b93f-6b5776c757a0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:26.095110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:26.096586 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:26.097524 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:26.098003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] PATH_INFO: `/v3/users/26745424b0a74578837ed4c7b2f432ab` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:26.100912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] RBAC: Authorizing `identity:delete_user(user_id=26745424b0a74578837ed4c7b2f432ab)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:26.104353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:26.107030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1125/2237] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:26.117629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40734b8b-c876-4c35-8f69-3c27f997bb74 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:26.122027 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-40734b8b-c876-4c35-8f69-3c27f997bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:26.260815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26745424b0a74578837ed4c7b2f432ab'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:26.275461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40734b8b-c876-4c35-8f69-3c27f997bb74 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:26.276188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26745424b0a74578837ed4c7b2f432ab'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:26.280688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b92eca-64a3-491a-8267-a027c1fad56a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:26.281900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b92eca-64a3-491a-8267-a027c1fad56a service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:26.285297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b92eca-64a3-491a-8267-a027c1fad56a service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:26.286954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b92eca-64a3-491a-8267-a027c1fad56a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:26.303329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b92eca-64a3-491a-8267-a027c1fad56a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:26.307639 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b92eca-64a3-491a-8267-a027c1fad56a service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:26.334793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26745424b0a74578837ed4c7b2f432ab'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:26.336011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26745424b0a74578837ed4c7b2f432ab'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:26.352159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26745424b0a74578837ed4c7b2f432ab'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:26.358438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1126/2238] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:27:26.363954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1113/2239] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:25 2022] DELETE /identity/v3/users/26745424b0a74578837ed4c7b2f432ab => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:26.424760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:26.430913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:26.656602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bea3af-24f5-4e57-bdd0-444a45d1229a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:26.684330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:26.685898 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:26.686389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:26.686880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] PATH_INFO: `/v3/users/cfdea1465de641c382e0cade871d0c6a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:26.694825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdea1465de641c382e0cade871d0c6a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:26.698675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:26.814272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdea1465de641c382e0cade871d0c6a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:26.833374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdea1465de641c382e0cade871d0c6a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:26.881979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdea1465de641c382e0cade871d0c6a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:26.886654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdea1465de641c382e0cade871d0c6a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:26.923591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdea1465de641c382e0cade871d0c6a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:26.945734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1114/2240] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:26 2022] DELETE /identity/v3/users/cfdea1465de641c382e0cade871d0c6a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:26.951937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343acaef-4052-41bf-b0b6-e07f8bd794e0 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:26.953816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343acaef-4052-41bf-b0b6-e07f8bd794e0 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:26.954633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343acaef-4052-41bf-b0b6-e07f8bd794e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:26.991820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-343acaef-4052-41bf-b0b6-e07f8bd794e0 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:26.994934 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-343acaef-4052-41bf-b0b6-e07f8bd794e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:27.061578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:27.064397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:27.229270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1127/2241] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:27.229270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343acaef-4052-41bf-b0b6-e07f8bd794e0 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:27.233742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-343acaef-4052-41bf-b0b6-e07f8bd794e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:27.269146 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495c391-bfca-4ad6-823b-c3ced60d44f4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:27.276243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343acaef-4052-41bf-b0b6-e07f8bd794e0 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:27.283117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:27.285921 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:27.287447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:27.287896 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:27.288324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] PATH_INFO: `/v3/projects/6bc0010b8e7d451ea0d8933efcee5165` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:27.290065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc0010b8e7d451ea0d8933efcee5165)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:27.295667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:27.298074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:27.298578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:27.299069 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] PATH_INFO: `/v3/users/e6bb7d36496d439780ce09aec27b5724` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:27.305065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6bb7d36496d439780ce09aec27b5724)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:27.310611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:27.386740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc0010b8e7d451ea0d8933efcee5165', 'request_id': 'req-1c74b9b3-12c5-4440-a102-0e6d2d05d384'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:27.406644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc0010b8e7d451ea0d8933efcee5165', 'request_id': 'req-1c74b9b3-12c5-4440-a102-0e6d2d05d384'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:27.426960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc0010b8e7d451ea0d8933efcee5165', 'request_id': 'req-1c74b9b3-12c5-4440-a102-0e6d2d05d384'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:27.437010 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6bb7d36496d439780ce09aec27b5724'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:27.465361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6bb7d36496d439780ce09aec27b5724'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:27.472134 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] The token cache is being invalidate because project 6bc0010b8e7d451ea0d8933efcee5165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:27.472628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:27.478805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:27.494128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1128/2242] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:27 2022] DELETE /identity/v3/projects/6bc0010b8e7d451ea0d8933efcee5165 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:27.494128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:27.494128 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:27.518296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6bb7d36496d439780ce09aec27b5724'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:27.522165 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6bb7d36496d439780ce09aec27b5724'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:27.546284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-45800043-4b2d-4505-8e49-880472332db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6bb7d36496d439780ce09aec27b5724'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:27.577948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1115/2243] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:27 2022] DELETE /identity/v3/users/e6bb7d36496d439780ce09aec27b5724 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:27.589006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba411c1-f5cf-434e-b97b-c79a194aaaf1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:27.589518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba411c1-f5cf-434e-b97b-c79a194aaaf1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:27.589885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba411c1-f5cf-434e-b97b-c79a194aaaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:27.668362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3ba411c1-f5cf-434e-b97b-c79a194aaaf1 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:27.670293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3ba411c1-f5cf-434e-b97b-c79a194aaaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:27.701493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74b9b3-12c5-4440-a102-0e6d2d05d384 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:27.747244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1116/2244] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:27.754946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9045fda-3e5e-4194-9ee4-5edfbf15fca9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:27.754946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9045fda-3e5e-4194-9ee4-5edfbf15fca9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:27.754946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9045fda-3e5e-4194-9ee4-5edfbf15fca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:27.782509 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a9045fda-3e5e-4194-9ee4-5edfbf15fca9 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:27.783750 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a9045fda-3e5e-4194-9ee4-5edfbf15fca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:27.800402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1117/2245] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:27.800402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297ec61-6d36-4094-ad4f-2fc4fadbd658 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:27.800402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297ec61-6d36-4094-ad4f-2fc4fadbd658 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:27.800402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297ec61-6d36-4094-ad4f-2fc4fadbd658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:27.821401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b297ec61-6d36-4094-ad4f-2fc4fadbd658 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:27.822688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b297ec61-6d36-4094-ad4f-2fc4fadbd658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:27.832674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1118/2246] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:27.840273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297ec61-6d36-4094-ad4f-2fc4fadbd658 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:27.851479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297ec61-6d36-4094-ad4f-2fc4fadbd658 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:27.876267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a5164-aa95-4efe-9a4f-67ce0216c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:27.880038 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a5164-aa95-4efe-9a4f-67ce0216c596 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:27.880547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a5164-aa95-4efe-9a4f-67ce0216c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:27.882279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a5164-aa95-4efe-9a4f-67ce0216c596 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:27.883620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a5164-aa95-4efe-9a4f-67ce0216c596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:27:27.887085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a5164-aa95-4efe-9a4f-67ce0216c596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:27.894089 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a5164-aa95-4efe-9a4f-67ce0216c596 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:27.930637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6edde6-64aa-4895-a195-603325fa619a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:27.931353 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6edde6-64aa-4895-a195-603325fa619a service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:27.931665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6edde6-64aa-4895-a195-603325fa619a service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:27.931937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6edde6-64aa-4895-a195-603325fa619a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:27.935874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ca6edde6-64aa-4895-a195-603325fa619a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:27.940038 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1119/2247] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:27:27.943471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a5164-aa95-4efe-9a4f-67ce0216c596 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:27.952691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-841a5164-aa95-4efe-9a4f-67ce0216c596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:27.959682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6edde6-64aa-4895-a195-603325fa619a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:27.961650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6edde6-64aa-4895-a195-603325fa619a service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:27.976223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1129/2248] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:27.977356 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6edde6-64aa-4895-a195-603325fa619a service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:27.986482 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a5164-aa95-4efe-9a4f-67ce0216c596 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:27.992810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6edde6-64aa-4895-a195-603325fa619a service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:27.998579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6647a-69d3-4f45-9bf4-252e6b1eec3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:28.001522 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6647a-69d3-4f45-9bf4-252e6b1eec3b service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:28.001823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6647a-69d3-4f45-9bf4-252e6b1eec3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:28.002225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6647a-69d3-4f45-9bf4-252e6b1eec3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:28.004378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8917-e35c-4d83-b73b-1cac857935ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:28.005544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8917-e35c-4d83-b73b-1cac857935ec admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:28.006469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8917-e35c-4d83-b73b-1cac857935ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:28.007189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8917-e35c-4d83-b73b-1cac857935ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:28.010143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a8917-e35c-4d83-b73b-1cac857935ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:28.016471 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a8917-e35c-4d83-b73b-1cac857935ec admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:28.034394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6647a-69d3-4f45-9bf4-252e6b1eec3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:28.036328 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6647a-69d3-4f45-9bf4-252e6b1eec3b service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:28.067730 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1120/2249] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:28.089416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1130/2250] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:27 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:28.094499 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6647a-69d3-4f45-9bf4-252e6b1eec3b service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:28.104923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6647a-69d3-4f45-9bf4-252e6b1eec3b service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:28.250065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58eb8b-a6c6-4ca7-be1b-f1f54855474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:28.251244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58eb8b-a6c6-4ca7-be1b-f1f54855474c admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:28.251736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58eb8b-a6c6-4ca7-be1b-f1f54855474c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:28.252218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58eb8b-a6c6-4ca7-be1b-f1f54855474c admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:28.253595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58eb8b-a6c6-4ca7-be1b-f1f54855474c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:28.259468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58eb8b-a6c6-4ca7-be1b-f1f54855474c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:28.289966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1121/2251] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:28 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:27:28.296099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8917-e35c-4d83-b73b-1cac857935ec admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:28.314400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8917-e35c-4d83-b73b-1cac857935ec admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:28.324165 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ed3b-a123-4a2d-827c-9a234c86ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:28.325403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ed3b-a123-4a2d-827c-9a234c86ffd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:28.325986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ed3b-a123-4a2d-827c-9a234c86ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:28.326467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ed3b-a123-4a2d-827c-9a234c86ffd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:28.327877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140ed3b-a123-4a2d-827c-9a234c86ffd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:28.332983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140ed3b-a123-4a2d-827c-9a234c86ffd9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:28.361715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58eb8b-a6c6-4ca7-be1b-f1f54855474c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:28.370736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1131/2252] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:28.386042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58eb8b-a6c6-4ca7-be1b-f1f54855474c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:28.398088 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff5ad3-388d-4954-ba30-138a71facc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:28.399493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff5ad3-388d-4954-ba30-138a71facc9d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:28.400049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff5ad3-388d-4954-ba30-138a71facc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:28.400681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff5ad3-388d-4954-ba30-138a71facc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:28.402495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff5ad3-388d-4954-ba30-138a71facc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:28.406202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff5ad3-388d-4954-ba30-138a71facc9d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:28.437872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ed3b-a123-4a2d-827c-9a234c86ffd9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:28.446691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1122/2253] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:28.457571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ed3b-a123-4a2d-827c-9a234c86ffd9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:28.465610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8174f-bc73-422d-85cf-ae3aa1be7ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:28.467751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8174f-bc73-422d-85cf-ae3aa1be7ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:28.468319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8174f-bc73-422d-85cf-ae3aa1be7ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:28.468895 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8174f-bc73-422d-85cf-ae3aa1be7ae6 admin admin] PATH_INFO: `/v3/projects/4b34967119424c13856edb6b5d9a643c/users/fdbf8c62c7e1413eb4099c81418652d2/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:28.496245 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8174f-bc73-422d-85cf-ae3aa1be7ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b34967119424c13856edb6b5d9a643c, user_id=fdbf8c62c7e1413eb4099c81418652d2, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:28.499651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8174f-bc73-422d-85cf-ae3aa1be7ae6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:28.540772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1132/2254] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:28 2022] PUT /identity/v3/projects/4b34967119424c13856edb6b5d9a643c/users/fdbf8c62c7e1413eb4099c81418652d2/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:28.549200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94277697-e4b9-43bf-a349-433f0eab6fa0 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:28.549872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94277697-e4b9-43bf-a349-433f0eab6fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:28.550465 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94277697-e4b9-43bf-a349-433f0eab6fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:28.609028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-94277697-e4b9-43bf-a349-433f0eab6fa0 None None] MFA Rules not processed for user `fdbf8c62c7e1413eb4099c81418652d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:28.609028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-94277697-e4b9-43bf-a349-433f0eab6fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:28.761139 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1123/2255] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:28.767555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8174f-bc73-422d-85cf-ae3aa1be7ae6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:28.892266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94277697-e4b9-43bf-a349-433f0eab6fa0 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:28.894138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-94277697-e4b9-43bf-a349-433f0eab6fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:28.905445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8174f-bc73-422d-85cf-ae3aa1be7ae6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:28.913020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81106688-480d-456a-8e8c-15a6eccc8441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:28.917479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81106688-480d-456a-8e8c-15a6eccc8441 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:28.917954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81106688-480d-456a-8e8c-15a6eccc8441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:28.918098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81106688-480d-456a-8e8c-15a6eccc8441 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:28.918776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81106688-480d-456a-8e8c-15a6eccc8441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:28.923806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81106688-480d-456a-8e8c-15a6eccc8441 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:28.963217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94277697-e4b9-43bf-a349-433f0eab6fa0 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:28.969559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1133/2256] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:28 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:28.971161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81106688-480d-456a-8e8c-15a6eccc8441 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:29.074638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81106688-480d-456a-8e8c-15a6eccc8441 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:29.085451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55c5f6-ca66-424e-aa1b-9b24bd9fa56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:29.085451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55c5f6-ca66-424e-aa1b-9b24bd9fa56d admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:29.085451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55c5f6-ca66-424e-aa1b-9b24bd9fa56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:29.087378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55c5f6-ca66-424e-aa1b-9b24bd9fa56d admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:29.089913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55c5f6-ca66-424e-aa1b-9b24bd9fa56d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:29.093992 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55c5f6-ca66-424e-aa1b-9b24bd9fa56d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:29.134652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1134/2257] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:28 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:29.136605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55c5f6-ca66-424e-aa1b-9b24bd9fa56d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:29.157619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55c5f6-ca66-424e-aa1b-9b24bd9fa56d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:29.165597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd3349-7e17-49aa-9808-ad4626c6f1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:29.166727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3349-7e17-49aa-9808-ad4626c6f1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:29.167211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3349-7e17-49aa-9808-ad4626c6f1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:29.167639 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3349-7e17-49aa-9808-ad4626c6f1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:29.170221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd3349-7e17-49aa-9808-ad4626c6f1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:29.173038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd3349-7e17-49aa-9808-ad4626c6f1f4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:29.190953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:29.191883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:29.192161 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:29.192432 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] PATH_INFO: `/v3/projects/967f60f2af934cdb93fa2baa9baf704c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:29.194134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967f60f2af934cdb93fa2baa9baf704c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:29.196362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:29.197299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1135/2258] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:29.199903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd3349-7e17-49aa-9808-ad4626c6f1f4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:29.236084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd3349-7e17-49aa-9808-ad4626c6f1f4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:29.254325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018279fc-5e9d-4342-b230-878eea7503a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:29.255883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018279fc-5e9d-4342-b230-878eea7503a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:29.256175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018279fc-5e9d-4342-b230-878eea7503a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:29.256511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018279fc-5e9d-4342-b230-878eea7503a9 admin admin] PATH_INFO: `/v3/projects/2c8dbd8447654f22991eaa57e27eceef/users/62189485bdaf42ae94894a4661678ebe/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:29.319054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967f60f2af934cdb93fa2baa9baf704c', 'request_id': 'req-ab438f58-d231-498f-88ee-1b25917b3fc3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:29.321486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018279fc-5e9d-4342-b230-878eea7503a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8dbd8447654f22991eaa57e27eceef, user_id=62189485bdaf42ae94894a4661678ebe, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:29.325048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018279fc-5e9d-4342-b230-878eea7503a9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:29.338889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967f60f2af934cdb93fa2baa9baf704c', 'request_id': 'req-ab438f58-d231-498f-88ee-1b25917b3fc3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:29.367558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967f60f2af934cdb93fa2baa9baf704c', 'request_id': 'req-ab438f58-d231-498f-88ee-1b25917b3fc3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:29.397525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1136/2259] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:29 2022] PUT /identity/v3/projects/2c8dbd8447654f22991eaa57e27eceef/users/62189485bdaf42ae94894a4661678ebe/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:29.403004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] The token cache is being invalidate because project 967f60f2af934cdb93fa2baa9baf704c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:29.403004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:29.403816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ab438f58-d231-498f-88ee-1b25917b3fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:29.411434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1124/2260] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:28 2022] DELETE /identity/v3/projects/967f60f2af934cdb93fa2baa9baf704c => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:29.417614 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018279fc-5e9d-4342-b230-878eea7503a9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:29.419110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1ed3-f529-4265-a0c8-d601172ade5b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:29.419583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1ed3-f529-4265-a0c8-d601172ade5b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:29.420024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1ed3-f529-4265-a0c8-d601172ade5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:29.430631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-018279fc-5e9d-4342-b230-878eea7503a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:29.475613 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-dd3c1ed3-f529-4265-a0c8-d601172ade5b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:29.477500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dd3c1ed3-f529-4265-a0c8-d601172ade5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:29.623017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018279fc-5e9d-4342-b230-878eea7503a9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:29.634672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1125/2261] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:29.644384 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189407b-91eb-4da5-a390-92614c2579f3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:29.644927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189407b-91eb-4da5-a390-92614c2579f3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:29.645590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189407b-91eb-4da5-a390-92614c2579f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:29.651914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c1655-49f7-4a1f-a1a4-3964da69be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:29.652627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c1655-49f7-4a1f-a1a4-3964da69be44 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:29.652911 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c1655-49f7-4a1f-a1a4-3964da69be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:29.653183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c1655-49f7-4a1f-a1a4-3964da69be44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:29.654028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c1655-49f7-4a1f-a1a4-3964da69be44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:29.656538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c1655-49f7-4a1f-a1a4-3964da69be44 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:29.701648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1137/2262] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:29.703701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c1655-49f7-4a1f-a1a4-3964da69be44 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:29.709379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d189407b-91eb-4da5-a390-92614c2579f3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:29.713172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d189407b-91eb-4da5-a390-92614c2579f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:29.742578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1126/2263] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:27:29.750317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189407b-91eb-4da5-a390-92614c2579f3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:29.773637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c1655-49f7-4a1f-a1a4-3964da69be44 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:29.791643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189407b-91eb-4da5-a390-92614c2579f3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:29.803512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca740f-a645-4641-a154-87ff606a41d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:29.804486 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca740f-a645-4641-a154-87ff606a41d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:29.804838 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca740f-a645-4641-a154-87ff606a41d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:29.805366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca740f-a645-4641-a154-87ff606a41d6 admin admin] PATH_INFO: `/v3/projects/2c8dbd8447654f22991eaa57e27eceef/users/62189485bdaf42ae94894a4661678ebe/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:29.809810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3501ab-222d-43cd-8d6c-036b56cad013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:29.810393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca740f-a645-4641-a154-87ff606a41d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8dbd8447654f22991eaa57e27eceef, user_id=62189485bdaf42ae94894a4661678ebe, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:29.811173 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3501ab-222d-43cd-8d6c-036b56cad013 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:29.824788 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca740f-a645-4641-a154-87ff606a41d6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:29.825799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3501ab-222d-43cd-8d6c-036b56cad013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:29.826135 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3501ab-222d-43cd-8d6c-036b56cad013 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:29.827438 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3501ab-222d-43cd-8d6c-036b56cad013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:27:29.827951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3501ab-222d-43cd-8d6c-036b56cad013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:29.831449 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3501ab-222d-43cd-8d6c-036b56cad013 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:29.877748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1138/2264] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:29 2022] PUT /identity/v3/projects/2c8dbd8447654f22991eaa57e27eceef/users/62189485bdaf42ae94894a4661678ebe/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:29.877748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca740f-a645-4641-a154-87ff606a41d6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:29.877748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c5ca740f-a645-4641-a154-87ff606a41d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:29.909352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1127/2265] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:27:29.911019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeecb40-5551-47cd-9ace-ab28117ec959 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:29.911226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeecb40-5551-47cd-9ace-ab28117ec959 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:29.911502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeecb40-5551-47cd-9ace-ab28117ec959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:29.959129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1eeecb40-5551-47cd-9ace-ab28117ec959 None None] MFA Rules not processed for user `62189485bdaf42ae94894a4661678ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:29.960352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1eeecb40-5551-47cd-9ace-ab28117ec959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:30.090543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1128/2266] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:30.097876 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeecb40-5551-47cd-9ace-ab28117ec959 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:30.139569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca740f-a645-4641-a154-87ff606a41d6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:30.147858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:30.149106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:30.149562 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:30.149989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] PATH_INFO: `/v3/projects/73802ea8e00446928c5108b4a7805c2a` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:30.152092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73802ea8e00446928c5108b4a7805c2a)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:30.156159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:30.328072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeecb40-5551-47cd-9ace-ab28117ec959 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:30.329846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73802ea8e00446928c5108b4a7805c2a', 'request_id': 'req-e69649ed-b44c-4773-a886-2fb162adae18'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:30.354831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73802ea8e00446928c5108b4a7805c2a', 'request_id': 'req-e69649ed-b44c-4773-a886-2fb162adae18'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:30.366029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73802ea8e00446928c5108b4a7805c2a', 'request_id': 'req-e69649ed-b44c-4773-a886-2fb162adae18'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:30.391811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] The token cache is being invalidate because project 73802ea8e00446928c5108b4a7805c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:30.392303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:30.393735 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:30.396831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1139/2267] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:29 2022] DELETE /identity/v3/projects/73802ea8e00446928c5108b4a7805c2a => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:30.398462 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:30.401255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:30.549740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69649ed-b44c-4773-a886-2fb162adae18 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:30.550173 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfe0bb-ac11-4a6d-af2a-173b3f60960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:30.551806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfe0bb-ac11-4a6d-af2a-173b3f60960c admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:30.552451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfe0bb-ac11-4a6d-af2a-173b3f60960c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:30.554523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfe0bb-ac11-4a6d-af2a-173b3f60960c admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:30.557303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfe0bb-ac11-4a6d-af2a-173b3f60960c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:30.563508 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfe0bb-ac11-4a6d-af2a-173b3f60960c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:30.567050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018e84b-2f29-4486-ab7d-8b79322ee70d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:30.568299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e84b-2f29-4486-ab7d-8b79322ee70d service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:30.568767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e84b-2f29-4486-ab7d-8b79322ee70d service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:30.569285 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018e84b-2f29-4486-ab7d-8b79322ee70d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:30.589584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-2018e84b-2f29-4486-ab7d-8b79322ee70d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:30.649329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1129/2268] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:30 2022] POST /identity/v3/projects => generated 373 bytes in 554 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:30.649329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfe0bb-ac11-4a6d-af2a-173b3f60960c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:30.653358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2fcfe0bb-ac11-4a6d-af2a-173b3f60960c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:30.730608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018e84b-2f29-4486-ab7d-8b79322ee70d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:30.734619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018e84b-2f29-4486-ab7d-8b79322ee70d service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:30.758421 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1140/2269] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:30.771167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018e84b-2f29-4486-ab7d-8b79322ee70d service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:30.776111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-2018e84b-2f29-4486-ab7d-8b79322ee70d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:30.790905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfe0bb-ac11-4a6d-af2a-173b3f60960c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:30.797472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:30.798994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:30.799552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:30.800088 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] PATH_INFO: `/v3/users/f3a501e7c27e42a98312854210918b0d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:30.802546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a501e7c27e42a98312854210918b0d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:30.805326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:30.831359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018e84b-2f29-4486-ab7d-8b79322ee70d service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:30.842716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41790ddf-1f26-407d-a82b-24fda238763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:30.844012 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41790ddf-1f26-407d-a82b-24fda238763a admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:30.844472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41790ddf-1f26-407d-a82b-24fda238763a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:30.847783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41790ddf-1f26-407d-a82b-24fda238763a admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:30.849040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41790ddf-1f26-407d-a82b-24fda238763a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:30.854898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41790ddf-1f26-407d-a82b-24fda238763a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:30.909529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1141/2270] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:30 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:30.915960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41790ddf-1f26-407d-a82b-24fda238763a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:30.930540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41790ddf-1f26-407d-a82b-24fda238763a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:30.937037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e545c30-1157-4bdf-9fe7-0becca1ba736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:30.937866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e545c30-1157-4bdf-9fe7-0becca1ba736 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:30.938222 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e545c30-1157-4bdf-9fe7-0becca1ba736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:30.938547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e545c30-1157-4bdf-9fe7-0becca1ba736 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:30.939490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e545c30-1157-4bdf-9fe7-0becca1ba736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:30.941363 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e545c30-1157-4bdf-9fe7-0becca1ba736 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:30.943500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a501e7c27e42a98312854210918b0d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:30.958412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1142/2271] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:30.965147 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e545c30-1157-4bdf-9fe7-0becca1ba736 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:30.969673 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a501e7c27e42a98312854210918b0d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:30.989967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a501e7c27e42a98312854210918b0d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:30.991094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a501e7c27e42a98312854210918b0d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:30.999072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e545c30-1157-4bdf-9fe7-0becca1ba736 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:31.006383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a501e7c27e42a98312854210918b0d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:31.020286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1130/2272] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:30 2022] DELETE /identity/v3/users/f3a501e7c27e42a98312854210918b0d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:31.022522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da391024-4c6b-4923-963c-df45fe1f6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:31.023744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da391024-4c6b-4923-963c-df45fe1f6292 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:31.024307 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da391024-4c6b-4923-963c-df45fe1f6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:31.024915 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da391024-4c6b-4923-963c-df45fe1f6292 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:31.026357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da391024-4c6b-4923-963c-df45fe1f6292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:31.027898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da391024-4c6b-4923-963c-df45fe1f6292 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:31.051725 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1143/2273] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:31.058205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:31.060793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:31.228044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23a3d5-5872-4cd8-a1b8-f15699999e4e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:31.249907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c9b95-17b6-4be3-bce1-b89cdfa3d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:31.251896 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c9b95-17b6-4be3-bce1-b89cdfa3d5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:31.252625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c9b95-17b6-4be3-bce1-b89cdfa3d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:31.257712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c9b95-17b6-4be3-bce1-b89cdfa3d5d8 admin admin] PATH_INFO: `/v3/projects/4f18e9b323194d6eb7b2eb68a04ae289/users/8440f364fd324069af57a305c935d16c/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:31.300021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c9b95-17b6-4be3-bce1-b89cdfa3d5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f18e9b323194d6eb7b2eb68a04ae289, user_id=8440f364fd324069af57a305c935d16c, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:31.312435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c9b95-17b6-4be3-bce1-b89cdfa3d5d8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:31.385308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1131/2274] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:31 2022] PUT /identity/v3/projects/4f18e9b323194d6eb7b2eb68a04ae289/users/8440f364fd324069af57a305c935d16c/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:31.395933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381fa8-0234-4894-986d-475af34dab69 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:31.398532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381fa8-0234-4894-986d-475af34dab69 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:31.399299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381fa8-0234-4894-986d-475af34dab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:31.461955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-38381fa8-0234-4894-986d-475af34dab69 None None] MFA Rules not processed for user `8440f364fd324069af57a305c935d16c`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:31.464037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-38381fa8-0234-4894-986d-475af34dab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:31.704137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1144/2275] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:31.842654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c9b95-17b6-4be3-bce1-b89cdfa3d5d8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:31.846853 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ca2c9b95-17b6-4be3-bce1-b89cdfa3d5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:31.868394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381fa8-0234-4894-986d-475af34dab69 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:31.871024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-38381fa8-0234-4894-986d-475af34dab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:32.010695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c9b95-17b6-4be3-bce1-b89cdfa3d5d8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:32.016708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26136ecc-f9c6-4a65-9a35-b72487fe2af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:32.017832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26136ecc-f9c6-4a65-9a35-b72487fe2af5 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:32.018283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26136ecc-f9c6-4a65-9a35-b72487fe2af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:32.018747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26136ecc-f9c6-4a65-9a35-b72487fe2af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:32.029669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381fa8-0234-4894-986d-475af34dab69 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:32.035791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26136ecc-f9c6-4a65-9a35-b72487fe2af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:32.037039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:32.038779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26136ecc-f9c6-4a65-9a35-b72487fe2af5 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:32.048774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:32.049579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:32.055519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] PATH_INFO: `/v3/projects/448f774b12c64645bce16badaba716c4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:32.059581 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=448f774b12c64645bce16badaba716c4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:32.065293 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:32.067193 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1132/2276] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:32.185554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448f774b12c64645bce16badaba716c4', 'request_id': 'req-ea72344a-9c4f-4451-97f7-c69e88ddd901'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:32.194008 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448f774b12c64645bce16badaba716c4', 'request_id': 'req-ea72344a-9c4f-4451-97f7-c69e88ddd901'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:32.200982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448f774b12c64645bce16badaba716c4', 'request_id': 'req-ea72344a-9c4f-4451-97f7-c69e88ddd901'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:32.201948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26136ecc-f9c6-4a65-9a35-b72487fe2af5 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:32.203582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-26136ecc-f9c6-4a65-9a35-b72487fe2af5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:32.236645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26136ecc-f9c6-4a65-9a35-b72487fe2af5 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:32.262224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] The token cache is being invalidate because project 448f774b12c64645bce16badaba716c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:32.262700 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:32.263709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ea72344a-9c4f-4451-97f7-c69e88ddd901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:32.272326 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1145/2277] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:31 2022] DELETE /identity/v3/projects/448f774b12c64645bce16badaba716c4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:32.282782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d187-63f9-43e8-8c4d-b8dcd7b12701 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:32.283686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d187-63f9-43e8-8c4d-b8dcd7b12701 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:32.284585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5d187-63f9-43e8-8c4d-b8dcd7b12701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:32.361701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-efd5d187-63f9-43e8-8c4d-b8dcd7b12701 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:32.381472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-efd5d187-63f9-43e8-8c4d-b8dcd7b12701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:32.493458 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:32.501518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:32.502315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:32.503195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] PATH_INFO: `/v3/users/fdbf8c62c7e1413eb4099c81418652d2` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:32.514691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbf8c62c7e1413eb4099c81418652d2)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:32.519848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:32.553259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1146/2278] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:32.564127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899880ae-f545-4e51-b259-35ba5ef8b9f2 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:32.564398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899880ae-f545-4e51-b259-35ba5ef8b9f2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:32.564762 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899880ae-f545-4e51-b259-35ba5ef8b9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:32.622757 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-899880ae-f545-4e51-b259-35ba5ef8b9f2 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:32.631758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-899880ae-f545-4e51-b259-35ba5ef8b9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:32.670341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1147/2279] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:32.674870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899880ae-f545-4e51-b259-35ba5ef8b9f2 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:32.694286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899880ae-f545-4e51-b259-35ba5ef8b9f2 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:32.697201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbf8c62c7e1413eb4099c81418652d2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:32.711585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907ac5-9499-443f-8ee9-d27e3b705664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:32.712270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907ac5-9499-443f-8ee9-d27e3b705664 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:32.712583 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907ac5-9499-443f-8ee9-d27e3b705664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:32.712855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84907ac5-9499-443f-8ee9-d27e3b705664 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:32.713645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84907ac5-9499-443f-8ee9-d27e3b705664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:27:32.714064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84907ac5-9499-443f-8ee9-d27e3b705664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:32.715573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84907ac5-9499-443f-8ee9-d27e3b705664 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:32.718253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbf8c62c7e1413eb4099c81418652d2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:32.742719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1148/2280] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:27:32.744685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907ac5-9499-443f-8ee9-d27e3b705664 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:32.754043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbf8c62c7e1413eb4099c81418652d2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:32.755766 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbf8c62c7e1413eb4099c81418652d2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:32.777440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84907ac5-9499-443f-8ee9-d27e3b705664 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:32.780400 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-8c005fb3-af00-4d53-a57a-f547bce29b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbf8c62c7e1413eb4099c81418652d2'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:32.792123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ce490-07c0-4c85-b014-4692d5f90e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:32.793149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ce490-07c0-4c85-b014-4692d5f90e6e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:32.795739 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ce490-07c0-4c85-b014-4692d5f90e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:32.796234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ce490-07c0-4c85-b014-4692d5f90e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:32.803171 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ce490-07c0-4c85-b014-4692d5f90e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:32.803383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1133/2281] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:32 2022] DELETE /identity/v3/users/fdbf8c62c7e1413eb4099c81418652d2 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:32.803483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ce490-07c0-4c85-b014-4692d5f90e6e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:32.806737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdfd78-bd52-4e5d-9569-6221cf9e0e31 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:32.807031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdfd78-bd52-4e5d-9569-6221cf9e0e31 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:32.807597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdfd78-bd52-4e5d-9569-6221cf9e0e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:32.864223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6bbdfd78-bd52-4e5d-9569-6221cf9e0e31 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:32.867884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6bbdfd78-bd52-4e5d-9569-6221cf9e0e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:32.879778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1149/2282] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:32 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:32.881863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ce490-07c0-4c85-b014-4692d5f90e6e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:32.886111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e22ce490-07c0-4c85-b014-4692d5f90e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:32.980607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ce490-07c0-4c85-b014-4692d5f90e6e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:32.988956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b1dc9-faca-4fdb-a5d6-364906767ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:32.990642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b1dc9-faca-4fdb-a5d6-364906767ffc admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:32.991438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b1dc9-faca-4fdb-a5d6-364906767ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:32.992198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b1dc9-faca-4fdb-a5d6-364906767ffc admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:32.993613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b1dc9-faca-4fdb-a5d6-364906767ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:33.001009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b1dc9-faca-4fdb-a5d6-364906767ffc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:33.003868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1134/2283] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:33.016940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdfd78-bd52-4e5d-9569-6221cf9e0e31 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:33.021010 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6bbdfd78-bd52-4e5d-9569-6221cf9e0e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:33.088278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1150/2284] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:32 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:33.090968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5670b-1482-4802-97b5-1b0bd39c230d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:33.091472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5670b-1482-4802-97b5-1b0bd39c230d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:33.092133 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5670b-1482-4802-97b5-1b0bd39c230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:33.131759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1cc5670b-1482-4802-97b5-1b0bd39c230d None None] MFA Rules not processed for user `bdd86efb97ad48a994f04304a8459e54`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:33.132653 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1cc5670b-1482-4802-97b5-1b0bd39c230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:33.226929 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbdfd78-bd52-4e5d-9569-6221cf9e0e31 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:33.233695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1151/2285] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:33.235343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5670b-1482-4802-97b5-1b0bd39c230d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:33.265189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5670b-1482-4802-97b5-1b0bd39c230d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:33.281724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef443c6e-16cf-4bff-993f-868cb48bd1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:33.282847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef443c6e-16cf-4bff-993f-868cb48bd1ba admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:33.283320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef443c6e-16cf-4bff-993f-868cb48bd1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:33.283790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef443c6e-16cf-4bff-993f-868cb48bd1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:33.285140 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef443c6e-16cf-4bff-993f-868cb48bd1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:33.288093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef443c6e-16cf-4bff-993f-868cb48bd1ba admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:33.322365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1152/2286] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:33.332127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef443c6e-16cf-4bff-993f-868cb48bd1ba admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:33.354855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef443c6e-16cf-4bff-993f-868cb48bd1ba admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:33.367562 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a01d28-c8c2-49e3-a768-342bc4899637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:33.367836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf79250-fce4-4885-8980-e505140a9f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:33.368336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01d28-c8c2-49e3-a768-342bc4899637 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:33.368580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01d28-c8c2-49e3-a768-342bc4899637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:33.368755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf79250-fce4-4885-8980-e505140a9f2a service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:33.368916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a01d28-c8c2-49e3-a768-342bc4899637 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:33.369178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf79250-fce4-4885-8980-e505140a9f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:33.369649 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a01d28-c8c2-49e3-a768-342bc4899637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:33.369798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf79250-fce4-4885-8980-e505140a9f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:33.371267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a01d28-c8c2-49e3-a768-342bc4899637 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:33.387908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf79250-fce4-4885-8980-e505140a9f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:33.391278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf79250-fce4-4885-8980-e505140a9f2a service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:33.394082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1153/2287] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:33.399402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a01d28-c8c2-49e3-a768-342bc4899637 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:33.425727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a01d28-c8c2-49e3-a768-342bc4899637 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:33.431756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1135/2288] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:27:33.436657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754572d6-d6ea-46ff-b26a-905ea85aa81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:33.438413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754572d6-d6ea-46ff-b26a-905ea85aa81d admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:33.438993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754572d6-d6ea-46ff-b26a-905ea85aa81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:33.439541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754572d6-d6ea-46ff-b26a-905ea85aa81d admin admin] PATH_INFO: `/v3/projects/ae7f0f1c7f4e49dfb85a141be2fa2c62/users/b5e833f99db348e49c3533490b1e4023/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:33.486340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754572d6-d6ea-46ff-b26a-905ea85aa81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7f0f1c7f4e49dfb85a141be2fa2c62, user_id=b5e833f99db348e49c3533490b1e4023, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:33.489415 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754572d6-d6ea-46ff-b26a-905ea85aa81d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:33.541994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1154/2289] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:33 2022] PUT /identity/v3/projects/ae7f0f1c7f4e49dfb85a141be2fa2c62/users/b5e833f99db348e49c3533490b1e4023/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:33.546422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd286fd-ed45-405a-a2ca-08cd022cc477 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:33.547111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd286fd-ed45-405a-a2ca-08cd022cc477 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:33.547708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd286fd-ed45-405a-a2ca-08cd022cc477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:33.620160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6dd286fd-ed45-405a-a2ca-08cd022cc477 None None] MFA Rules not processed for user `b5e833f99db348e49c3533490b1e4023`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:33.622150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6dd286fd-ed45-405a-a2ca-08cd022cc477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:33.827981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1136/2290] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:33.835965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754572d6-d6ea-46ff-b26a-905ea85aa81d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:33.982361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754572d6-d6ea-46ff-b26a-905ea85aa81d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:33.984637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd286fd-ed45-405a-a2ca-08cd022cc477 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:33.989776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6dd286fd-ed45-405a-a2ca-08cd022cc477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:33.991003 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1459e-c210-4ebb-b30e-6aadff16ed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:33.992719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1459e-c210-4ebb-b30e-6aadff16ed63 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:33.993257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1459e-c210-4ebb-b30e-6aadff16ed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:33.994351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1459e-c210-4ebb-b30e-6aadff16ed63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:33.999196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1459e-c210-4ebb-b30e-6aadff16ed63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:34.012451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1459e-c210-4ebb-b30e-6aadff16ed63 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:34.070215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1155/2291] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:33 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:34.074714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1459e-c210-4ebb-b30e-6aadff16ed63 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:34.090332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd286fd-ed45-405a-a2ca-08cd022cc477 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:34.211178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1459e-c210-4ebb-b30e-6aadff16ed63 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:34.223259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c4f5d-f9ff-4524-88c8-9b1da8a43520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:34.224572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c4f5d-f9ff-4524-88c8-9b1da8a43520 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:34.225059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c4f5d-f9ff-4524-88c8-9b1da8a43520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:34.225514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c4f5d-f9ff-4524-88c8-9b1da8a43520 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:34.227076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c4f5d-f9ff-4524-88c8-9b1da8a43520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:34.230882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c4f5d-f9ff-4524-88c8-9b1da8a43520 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:34.234144 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:34.236217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:34.236924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:34.237796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] PATH_INFO: `/v3/projects/4b34967119424c13856edb6b5d9a643c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:34.240619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b34967119424c13856edb6b5d9a643c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:34.245152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:34.291824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1156/2292] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:34 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:27:34.300738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c4f5d-f9ff-4524-88c8-9b1da8a43520 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:34.348535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c4f5d-f9ff-4524-88c8-9b1da8a43520 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:34.366990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3cd5b-d349-4c7f-8a89-4c45b6da6043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:34.369267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3cd5b-d349-4c7f-8a89-4c45b6da6043 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:34.369267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3cd5b-d349-4c7f-8a89-4c45b6da6043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:34.369598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3cd5b-d349-4c7f-8a89-4c45b6da6043 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:34.370814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3cd5b-d349-4c7f-8a89-4c45b6da6043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:34.377152 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3cd5b-d349-4c7f-8a89-4c45b6da6043 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:34.408945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b34967119424c13856edb6b5d9a643c', 'request_id': 'req-f14a3abe-aaa1-4386-8984-75be99539eb7'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:34.421101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b34967119424c13856edb6b5d9a643c', 'request_id': 'req-f14a3abe-aaa1-4386-8984-75be99539eb7'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:34.439182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b34967119424c13856edb6b5d9a643c', 'request_id': 'req-f14a3abe-aaa1-4386-8984-75be99539eb7'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:34.439951 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1157/2293] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:34.443563 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3cd5b-d349-4c7f-8a89-4c45b6da6043 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:34.469458 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] The token cache is being invalidate because project 4b34967119424c13856edb6b5d9a643c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:34.469743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:34.470414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:34.475000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1137/2294] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:33 2022] DELETE /identity/v3/projects/4b34967119424c13856edb6b5d9a643c => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:34.480004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3cd5b-d349-4c7f-8a89-4c45b6da6043 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:34.483189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:34.484675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:34.682276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58948657-4d28-405d-bc27-248b0661bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:34.683170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58948657-4d28-405d-bc27-248b0661bfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:34.683689 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58948657-4d28-405d-bc27-248b0661bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:34.684066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58948657-4d28-405d-bc27-248b0661bfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:34.685070 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58948657-4d28-405d-bc27-248b0661bfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:34.689890 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58948657-4d28-405d-bc27-248b0661bfd7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:34.711872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1158/2295] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:34.712806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58948657-4d28-405d-bc27-248b0661bfd7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:34.714385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a3abe-aaa1-4386-8984-75be99539eb7 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:34.714626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-58948657-4d28-405d-bc27-248b0661bfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:34.730292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:34.731187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:34.731466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:34.731786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] PATH_INFO: `/v3/users/62189485bdaf42ae94894a4661678ebe` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:34.733435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62189485bdaf42ae94894a4661678ebe)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:34.738909 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:34.739127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58948657-4d28-405d-bc27-248b0661bfd7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:34.750196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6c778-d50d-4a19-a450-0a38034d1d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:34.753878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6c778-d50d-4a19-a450-0a38034d1d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:34.754197 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6c778-d50d-4a19-a450-0a38034d1d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:34.754472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6c778-d50d-4a19-a450-0a38034d1d4f admin admin] PATH_INFO: `/v3/projects/23055406f1a449229f38aa2746318b38/users/740bc5cbba314ce48ea1f2fd286a63cf/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:34.824472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6c778-d50d-4a19-a450-0a38034d1d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23055406f1a449229f38aa2746318b38, user_id=740bc5cbba314ce48ea1f2fd286a63cf, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:34.833765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6c778-d50d-4a19-a450-0a38034d1d4f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:34.878538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1159/2296] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:34 2022] PUT /identity/v3/projects/23055406f1a449229f38aa2746318b38/users/740bc5cbba314ce48ea1f2fd286a63cf/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:34.880244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62189485bdaf42ae94894a4661678ebe'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:34.880938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92c5fb-b0bb-4ab5-83ab-8dac8d2620d7 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:34.881263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92c5fb-b0bb-4ab5-83ab-8dac8d2620d7 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:34.881564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92c5fb-b0bb-4ab5-83ab-8dac8d2620d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:34.890727 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62189485bdaf42ae94894a4661678ebe'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:34.939251 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62189485bdaf42ae94894a4661678ebe'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:34.941692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62189485bdaf42ae94894a4661678ebe'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:34.955849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62189485bdaf42ae94894a4661678ebe'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:34.961152 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-bc92c5fb-b0bb-4ab5-83ab-8dac8d2620d7 None None] MFA Rules not processed for user `740bc5cbba314ce48ea1f2fd286a63cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:34.962582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-bc92c5fb-b0bb-4ab5-83ab-8dac8d2620d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:34.973881 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1138/2297] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:34 2022] DELETE /identity/v3/users/62189485bdaf42ae94894a4661678ebe => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:35.071424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1160/2298] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:27:35.077024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:35.078513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:35.193442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f57f-7a59-4aef-a9cf-9c4344fa6a3d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:35.199116 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572fdc6-f4b9-4162-87d4-22c38320c1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:35.199813 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572fdc6-f4b9-4162-87d4-22c38320c1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:35.200095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572fdc6-f4b9-4162-87d4-22c38320c1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:35.200396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572fdc6-f4b9-4162-87d4-22c38320c1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:35.201108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572fdc6-f4b9-4162-87d4-22c38320c1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:35.203956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aaff1-2119-4e68-8a72-b4bb147c993c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:35.204153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572fdc6-f4b9-4162-87d4-22c38320c1a8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:35.204953 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aaff1-2119-4e68-8a72-b4bb147c993c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:35.205379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aaff1-2119-4e68-8a72-b4bb147c993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:35.253043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1139/2299] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:35 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:35.259560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572fdc6-f4b9-4162-87d4-22c38320c1a8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:35.282017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-df9aaff1-2119-4e68-8a72-b4bb147c993c None None] MFA Rules not processed for user `6b11396acc67415abb08ddddf5680df8`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:35.283963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-df9aaff1-2119-4e68-8a72-b4bb147c993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:35.427299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1161/2300] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:27:35.432068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9aaff1-2119-4e68-8a72-b4bb147c993c None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:35.441352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-df9aaff1-2119-4e68-8a72-b4bb147c993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:35.461949 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572fdc6-f4b9-4162-87d4-22c38320c1a8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:35.477618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9aaff1-2119-4e68-8a72-b4bb147c993c None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:35.486644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cc861-5df9-4595-8ff4-31fa3b6080c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:35.487015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc861-5df9-4595-8ff4-31fa3b6080c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:35.487226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668bd2d-1c70-4c44-b2f5-be73887a19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:35.487401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc861-5df9-4595-8ff4-31fa3b6080c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:35.487553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cc861-5df9-4595-8ff4-31fa3b6080c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:35.488388 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cc861-5df9-4595-8ff4-31fa3b6080c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:35.491877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668bd2d-1c70-4c44-b2f5-be73887a19ae admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:35.492167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668bd2d-1c70-4c44-b2f5-be73887a19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:35.492341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668bd2d-1c70-4c44-b2f5-be73887a19ae admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:35.493046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cc861-5df9-4595-8ff4-31fa3b6080c5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:35.494631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668bd2d-1c70-4c44-b2f5-be73887a19ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:35.497480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668bd2d-1c70-4c44-b2f5-be73887a19ae admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:35.542768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1140/2301] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:35 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:27:35.546401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1162/2302] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:35 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:35.554205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668bd2d-1c70-4c44-b2f5-be73887a19ae admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:35.554570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cc861-5df9-4595-8ff4-31fa3b6080c5 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:35.568764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668bd2d-1c70-4c44-b2f5-be73887a19ae admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:35.772682 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0053f11-f0d5-4843-b3a4-1c3452452afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:35.774214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0053f11-f0d5-4843-b3a4-1c3452452afa admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:35.775494 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0053f11-f0d5-4843-b3a4-1c3452452afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:35.776503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0053f11-f0d5-4843-b3a4-1c3452452afa admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:35.777416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0053f11-f0d5-4843-b3a4-1c3452452afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:35.780786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0053f11-f0d5-4843-b3a4-1c3452452afa admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:35.812418 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cc861-5df9-4595-8ff4-31fa3b6080c5 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:35.812712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1141/2303] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:35.819835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0053f11-f0d5-4843-b3a4-1c3452452afa admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:35.845252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a5f5-7914-4826-a53b-b11485feaf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:35.852774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a5f5-7914-4826-a53b-b11485feaf32 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:35.853358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a5f5-7914-4826-a53b-b11485feaf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:35.853835 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a5f5-7914-4826-a53b-b11485feaf32 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:35.868345 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8a5f5-7914-4826-a53b-b11485feaf32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:35.871544 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0053f11-f0d5-4843-b3a4-1c3452452afa admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:35.872738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8a5f5-7914-4826-a53b-b11485feaf32 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:35.899181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02371b00-4a40-4b69-9eb5-771fbb893c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:35.907145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02371b00-4a40-4b69-9eb5-771fbb893c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:35.907647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02371b00-4a40-4b69-9eb5-771fbb893c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:35.908111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02371b00-4a40-4b69-9eb5-771fbb893c89 admin admin] PATH_INFO: `/v3/projects/2d7036ffd9684b819a431dbf435f64f7/users/133c925392bd4bc19032a003c7f27822/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:35.945871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1163/2304] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:35 2022] POST /identity/v3/users => generated 294 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:35.951479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a5f5-7914-4826-a53b-b11485feaf32 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:35.963437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d7f8a5f5-7914-4826-a53b-b11485feaf32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:35.988404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02371b00-4a40-4b69-9eb5-771fbb893c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7036ffd9684b819a431dbf435f64f7, user_id=133c925392bd4bc19032a003c7f27822, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:35.996137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a5f5-7914-4826-a53b-b11485feaf32 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:35.996788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02371b00-4a40-4b69-9eb5-771fbb893c89 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:36.002775 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:36.004136 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:36.004491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:36.004918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] PATH_INFO: `/v3/projects/2c8dbd8447654f22991eaa57e27eceef` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:36.006441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8dbd8447654f22991eaa57e27eceef)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:36.010662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:36.044898 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1142/2305] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:35 2022] PUT /identity/v3/projects/2d7036ffd9684b819a431dbf435f64f7/users/133c925392bd4bc19032a003c7f27822/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:36.046685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02371b00-4a40-4b69-9eb5-771fbb893c89 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:36.128955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8dbd8447654f22991eaa57e27eceef', 'request_id': 'req-1d2ce746-f372-482a-9cf2-a35f9de84e71'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:36.150867 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8dbd8447654f22991eaa57e27eceef', 'request_id': 'req-1d2ce746-f372-482a-9cf2-a35f9de84e71'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:36.166256 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8dbd8447654f22991eaa57e27eceef', 'request_id': 'req-1d2ce746-f372-482a-9cf2-a35f9de84e71'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:36.213751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] The token cache is being invalidate because project 2c8dbd8447654f22991eaa57e27eceef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:36.214183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:36.224104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:36.226848 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1164/2306] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:35 2022] DELETE /identity/v3/projects/2c8dbd8447654f22991eaa57e27eceef => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:36.228249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:36.235117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:36.266577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02371b00-4a40-4b69-9eb5-771fbb893c89 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:36.495148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ce746-f372-482a-9cf2-a35f9de84e71 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:36.514540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf560c9-654a-479b-a28d-7380e3d010c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:36.515253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf560c9-654a-479b-a28d-7380e3d010c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:36.515654 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf560c9-654a-479b-a28d-7380e3d010c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:36.515805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf560c9-654a-479b-a28d-7380e3d010c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:36.516718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf560c9-654a-479b-a28d-7380e3d010c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:36.518435 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf560c9-654a-479b-a28d-7380e3d010c4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:36.526338 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9665a-16b1-4225-beef-8e47667c737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:36.527737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9665a-16b1-4225-beef-8e47667c737e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:36.528210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9665a-16b1-4225-beef-8e47667c737e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:36.530033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9665a-16b1-4225-beef-8e47667c737e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:36.535858 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9665a-16b1-4225-beef-8e47667c737e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:36.537750 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1165/2307] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:36.541297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3677d2-6283-46ab-bfca-ef8829191a97 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:36.541870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3677d2-6283-46ab-bfca-ef8829191a97 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:36.543752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9665a-16b1-4225-beef-8e47667c737e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:36.554509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3677d2-6283-46ab-bfca-ef8829191a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:36.564771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1143/2308] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:36.566999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9665a-16b1-4225-beef-8e47667c737e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:36.585857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9665a-16b1-4225-beef-8e47667c737e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:36.596017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05ac86-bd23-461f-bd02-37e99d179811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:36.597953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05ac86-bd23-461f-bd02-37e99d179811 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:36.598447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05ac86-bd23-461f-bd02-37e99d179811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:36.598933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05ac86-bd23-461f-bd02-37e99d179811 admin admin] PATH_INFO: `/v3/projects/2d7036ffd9684b819a431dbf435f64f7/users/133c925392bd4bc19032a003c7f27822/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:36.602279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05ac86-bd23-461f-bd02-37e99d179811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7036ffd9684b819a431dbf435f64f7, user_id=133c925392bd4bc19032a003c7f27822, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:36.605347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05ac86-bd23-461f-bd02-37e99d179811 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:36.616602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-7f3677d2-6283-46ab-bfca-ef8829191a97 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:36.618774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7f3677d2-6283-46ab-bfca-ef8829191a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:36.650120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1166/2309] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:36.650120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3677d2-6283-46ab-bfca-ef8829191a97 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:36.652303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7f3677d2-6283-46ab-bfca-ef8829191a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:36.677677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1144/2310] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:36 2022] PUT /identity/v3/projects/2d7036ffd9684b819a431dbf435f64f7/users/133c925392bd4bc19032a003c7f27822/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:36.680061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46582acc-4238-49e1-836e-e76128733b73 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:36.680492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46582acc-4238-49e1-836e-e76128733b73 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:36.680927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46582acc-4238-49e1-836e-e76128733b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:36.686781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3677d2-6283-46ab-bfca-ef8829191a97 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:36.773591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75334f2c-1982-48a3-8bd4-10a0848c15d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:36.774818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75334f2c-1982-48a3-8bd4-10a0848c15d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:36.775364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75334f2c-1982-48a3-8bd4-10a0848c15d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:36.775996 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75334f2c-1982-48a3-8bd4-10a0848c15d0 admin admin] PATH_INFO: `/v3/projects/04900e5c6b054e7f93e8d5fa84b29bce/users/c803c9435431420793f121bf7a7f0376/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:36.782084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-46582acc-4238-49e1-836e-e76128733b73 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:36.790902 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-46582acc-4238-49e1-836e-e76128733b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:36.811405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75334f2c-1982-48a3-8bd4-10a0848c15d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04900e5c6b054e7f93e8d5fa84b29bce, user_id=c803c9435431420793f121bf7a7f0376, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:36.817128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1145/2311] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:36.818857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75334f2c-1982-48a3-8bd4-10a0848c15d0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:36.819601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580b33-891c-48b8-aa46-bc0ecbc09141 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:36.820098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580b33-891c-48b8-aa46-bc0ecbc09141 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:36.820573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580b33-891c-48b8-aa46-bc0ecbc09141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:36.857443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1167/2312] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:36 2022] PUT /identity/v3/projects/04900e5c6b054e7f93e8d5fa84b29bce/users/c803c9435431420793f121bf7a7f0376/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:36.863483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75334f2c-1982-48a3-8bd4-10a0848c15d0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:36.891583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2d580b33-891c-48b8-aa46-bc0ecbc09141 None None] MFA Rules not processed for user `133c925392bd4bc19032a003c7f27822`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:36.893250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2d580b33-891c-48b8-aa46-bc0ecbc09141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:36.966947 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75334f2c-1982-48a3-8bd4-10a0848c15d0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:36.976584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a18d4-dfaf-407e-8a54-76f188eee571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:36.977723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a18d4-dfaf-407e-8a54-76f188eee571 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:36.978212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a18d4-dfaf-407e-8a54-76f188eee571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:36.978880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a18d4-dfaf-407e-8a54-76f188eee571 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:36.980309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a18d4-dfaf-407e-8a54-76f188eee571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:27:36.980845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a18d4-dfaf-407e-8a54-76f188eee571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:36.983832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a18d4-dfaf-407e-8a54-76f188eee571 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:37.012399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1168/2313] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:27:37.013995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a18d4-dfaf-407e-8a54-76f188eee571 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:37.038012 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a18d4-dfaf-407e-8a54-76f188eee571 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:37.038341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1146/2314] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:37.038944 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d580b33-891c-48b8-aa46-bc0ecbc09141 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:37.051261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a72b0-eece-41e8-bfa6-13f37bfde362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:37.052022 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a72b0-eece-41e8-bfa6-13f37bfde362 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:37.052405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a72b0-eece-41e8-bfa6-13f37bfde362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:37.052557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a72b0-eece-41e8-bfa6-13f37bfde362 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:37.054740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a72b0-eece-41e8-bfa6-13f37bfde362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:37.055553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a72b0-eece-41e8-bfa6-13f37bfde362 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:37.068255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d580b33-891c-48b8-aa46-bc0ecbc09141 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:37.072181 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1169/2315] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:37.073065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a72b0-eece-41e8-bfa6-13f37bfde362 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:37.078464 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3c6a72b0-eece-41e8-bfa6-13f37bfde362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:37.080974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ae7f-6b95-4821-bb58-cc8939795d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:37.082588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ae7f-6b95-4821-bb58-cc8939795d22 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:37.083052 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ae7f-6b95-4821-bb58-cc8939795d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:37.083529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ae7f-6b95-4821-bb58-cc8939795d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:37.084847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ae7f-6b95-4821-bb58-cc8939795d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:37.088708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ae7f-6b95-4821-bb58-cc8939795d22 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:37.138045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1147/2316] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:37 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:37.139519 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ae7f-6b95-4821-bb58-cc8939795d22 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:37.145298 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a72b0-eece-41e8-bfa6-13f37bfde362 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:37.219917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7d61-4829-4fc7-9cc2-a384ed24bc10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:37.220751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7d61-4829-4fc7-9cc2-a384ed24bc10 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:37.221274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7d61-4829-4fc7-9cc2-a384ed24bc10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:37.221781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7d61-4829-4fc7-9cc2-a384ed24bc10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:37.225442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f1ec7d61-4829-4fc7-9cc2-a384ed24bc10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:37.262880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ae7f-6b95-4821-bb58-cc8939795d22 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:37.271371 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e9a9-c22f-4510-a733-fe04ecc49fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:37.272540 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e9a9-c22f-4510-a733-fe04ecc49fae admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:37.273069 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e9a9-c22f-4510-a733-fe04ecc49fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:37.273540 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117e9a9-c22f-4510-a733-fe04ecc49fae admin admin] PATH_INFO: `/v3/projects/04900e5c6b054e7f93e8d5fa84b29bce/users/c803c9435431420793f121bf7a7f0376/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:37.276826 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117e9a9-c22f-4510-a733-fe04ecc49fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=04900e5c6b054e7f93e8d5fa84b29bce, user_id=c803c9435431420793f121bf7a7f0376, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:37.282070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117e9a9-c22f-4510-a733-fe04ecc49fae admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:37.302272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1148/2317] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:37 2022] PUT /identity/v3/projects/04900e5c6b054e7f93e8d5fa84b29bce/users/c803c9435431420793f121bf7a7f0376/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:37.303704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e9a9-c22f-4510-a733-fe04ecc49fae admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:37.369189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec7d61-4829-4fc7-9cc2-a384ed24bc10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:37.375010 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec7d61-4829-4fc7-9cc2-a384ed24bc10 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:37.398664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1170/2318] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:37.523971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117e9a9-c22f-4510-a733-fe04ecc49fae admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:37.533899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8d362-22d0-420e-864b-a7863106dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:37.535188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8d362-22d0-420e-864b-a7863106dee8 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:37.536075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8d362-22d0-420e-864b-a7863106dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:37.536578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8d362-22d0-420e-864b-a7863106dee8 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:37.537971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8d362-22d0-420e-864b-a7863106dee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:37.542463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8d362-22d0-420e-864b-a7863106dee8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:37.596077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1149/2319] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:37 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:37.602485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7d61-4829-4fc7-9cc2-a384ed24bc10 service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:37.671414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7d61-4829-4fc7-9cc2-a384ed24bc10 service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:37.693356 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550417bf-3930-4915-8637-4f09fc45c0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:37.694525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550417bf-3930-4915-8637-4f09fc45c0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:37.695018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550417bf-3930-4915-8637-4f09fc45c0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:37.695502 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550417bf-3930-4915-8637-4f09fc45c0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:37.696878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550417bf-3930-4915-8637-4f09fc45c0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:37.706076 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550417bf-3930-4915-8637-4f09fc45c0ad admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:37.765751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1171/2320] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:37.767550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8d362-22d0-420e-864b-a7863106dee8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:37.814159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8d362-22d0-420e-864b-a7863106dee8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:37.842539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd1fd0-eaf6-4e9e-8718-8145cbd773bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:37.843790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd1fd0-eaf6-4e9e-8718-8145cbd773bc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:37.844376 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd1fd0-eaf6-4e9e-8718-8145cbd773bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:37.844922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd1fd0-eaf6-4e9e-8718-8145cbd773bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:37.846557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd1fd0-eaf6-4e9e-8718-8145cbd773bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:37.858917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd1fd0-eaf6-4e9e-8718-8145cbd773bc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:37.918006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1150/2321] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:37.921210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550417bf-3930-4915-8637-4f09fc45c0ad admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:37.944780 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550417bf-3930-4915-8637-4f09fc45c0ad admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:37.968427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6db20d-350e-4636-8bec-651a149dc811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:37.970777 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6db20d-350e-4636-8bec-651a149dc811 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:37.971300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6db20d-350e-4636-8bec-651a149dc811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:37.971767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6db20d-350e-4636-8bec-651a149dc811 admin admin] PATH_INFO: `/v3/projects/82cdae976c9f4eb0b50a70b0ae36fdfc/users/36c5e8991fd3446da97f1f89d2a5fe3a/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:37.995853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6db20d-350e-4636-8bec-651a149dc811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cdae976c9f4eb0b50a70b0ae36fdfc, user_id=36c5e8991fd3446da97f1f89d2a5fe3a, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:38.000138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6db20d-350e-4636-8bec-651a149dc811 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:38.093591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1172/2322] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:37 2022] PUT /identity/v3/projects/82cdae976c9f4eb0b50a70b0ae36fdfc/users/36c5e8991fd3446da97f1f89d2a5fe3a/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:38.094507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173446df-4e79-4288-abb5-7df86fc30d8b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:38.094994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173446df-4e79-4288-abb5-7df86fc30d8b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:38.095547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173446df-4e79-4288-abb5-7df86fc30d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:38.283115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-173446df-4e79-4288-abb5-7df86fc30d8b None None] MFA Rules not processed for user `36c5e8991fd3446da97f1f89d2a5fe3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:38.290865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-173446df-4e79-4288-abb5-7df86fc30d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:38.482494 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1151/2323] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:27:38.500315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6db20d-350e-4636-8bec-651a149dc811 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:38.503430 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ae6db20d-350e-4636-8bec-651a149dc811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:38.676757 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6db20d-350e-4636-8bec-651a149dc811 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:38.690051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0c3df-f948-4159-9a83-b0b472b1171c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:38.691084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c3df-f948-4159-9a83-b0b472b1171c service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:38.691580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c3df-f948-4159-9a83-b0b472b1171c service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:38.692093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0c3df-f948-4159-9a83-b0b472b1171c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:38.718395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0c3df-f948-4159-9a83-b0b472b1171c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:38.720392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0c3df-f948-4159-9a83-b0b472b1171c service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:38.742441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1173/2324] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:27:38.785207 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173446df-4e79-4288-abb5-7df86fc30d8b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:39.019984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173446df-4e79-4288-abb5-7df86fc30d8b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:39.025650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:39.026573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:39.026851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:39.027125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] PATH_INFO: `/v3/users/36c5e8991fd3446da97f1f89d2a5fe3a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:39.028387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c5e8991fd3446da97f1f89d2a5fe3a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:39.031520 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:39.185752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c5e8991fd3446da97f1f89d2a5fe3a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:39.198231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c5e8991fd3446da97f1f89d2a5fe3a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:39.228407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c5e8991fd3446da97f1f89d2a5fe3a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:39.230126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c5e8991fd3446da97f1f89d2a5fe3a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:39.248738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c5e8991fd3446da97f1f89d2a5fe3a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:39.263431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1152/2325] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:38 2022] DELETE /identity/v3/users/36c5e8991fd3446da97f1f89d2a5fe3a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:39.267580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f8f62-4dd4-4401-94b3-7fd9bb089d5c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:39.268185 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f8f62-4dd4-4401-94b3-7fd9bb089d5c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:39.268532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f8f62-4dd4-4401-94b3-7fd9bb089d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:39.368939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-f08f8f62-4dd4-4401-94b3-7fd9bb089d5c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:39.382045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f08f8f62-4dd4-4401-94b3-7fd9bb089d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:39.525473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1174/2326] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:39.542591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:39.546109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:39.811029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f8f62-4dd4-4401-94b3-7fd9bb089d5c None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:39.812899 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f08f8f62-4dd4-4401-94b3-7fd9bb089d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:39.827403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218ecf2-5113-430c-98ae-186ff0a0039e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:39.846639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acc4ad-7fce-4d12-8791-2e59d783e75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:39.847744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc4ad-7fce-4d12-8791-2e59d783e75d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:39.848218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc4ad-7fce-4d12-8791-2e59d783e75d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:39.850215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acc4ad-7fce-4d12-8791-2e59d783e75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:39.916660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acc4ad-7fce-4d12-8791-2e59d783e75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:39.919002 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acc4ad-7fce-4d12-8791-2e59d783e75d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:39.954282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1153/2327] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:40.034941 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f8f62-4dd4-4401-94b3-7fd9bb089d5c None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:40.040084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c5305-af90-4dc2-b7ef-3c27fe39b94f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:40.040787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c5305-af90-4dc2-b7ef-3c27fe39b94f service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:40.041065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c5305-af90-4dc2-b7ef-3c27fe39b94f service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:40.041390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c5305-af90-4dc2-b7ef-3c27fe39b94f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:40.053984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b33c5305-af90-4dc2-b7ef-3c27fe39b94f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:40.229335 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c5305-af90-4dc2-b7ef-3c27fe39b94f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:40.230848 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c5305-af90-4dc2-b7ef-3c27fe39b94f service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:40.251109 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1175/2328] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:27:41.104921 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acc4ad-7fce-4d12-8791-2e59d783e75d service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:41.111229 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-94acc4ad-7fce-4d12-8791-2e59d783e75d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:41.204828 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acc4ad-7fce-4d12-8791-2e59d783e75d service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:41.262534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:41.264528 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:41.265222 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:41.265650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] PATH_INFO: `/v3/projects/82cdae976c9f4eb0b50a70b0ae36fdfc` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:41.275416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82cdae976c9f4eb0b50a70b0ae36fdfc)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:41.283737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:41.476952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82cdae976c9f4eb0b50a70b0ae36fdfc', 'request_id': 'req-27063017-7818-4ace-ab62-623f58bca72a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:41.496241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82cdae976c9f4eb0b50a70b0ae36fdfc', 'request_id': 'req-27063017-7818-4ace-ab62-623f58bca72a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:41.509818 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82cdae976c9f4eb0b50a70b0ae36fdfc', 'request_id': 'req-27063017-7818-4ace-ab62-623f58bca72a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:41.546128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] The token cache is being invalidate because project 82cdae976c9f4eb0b50a70b0ae36fdfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:41.548952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:41.550406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:41.562373 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1154/2329] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:41 2022] DELETE /identity/v3/projects/82cdae976c9f4eb0b50a70b0ae36fdfc => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:41.563680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c4de-df64-4e6d-b171-e4d6ef822b68 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:41.564425 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c4de-df64-4e6d-b171-e4d6ef822b68 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:41.564425 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c4de-df64-4e6d-b171-e4d6ef822b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:41.686199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:41.687558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:41.713383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d121c4de-df64-4e6d-b171-e4d6ef822b68 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:41.714660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d121c4de-df64-4e6d-b171-e4d6ef822b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:41.835955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27063017-7818-4ace-ab62-623f58bca72a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:41.851131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff56f1-fd87-4ac0-a00b-63c3f9c19f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:41.853083 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff56f1-fd87-4ac0-a00b-63c3f9c19f24 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:41.856893 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff56f1-fd87-4ac0-a00b-63c3f9c19f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:41.857700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff56f1-fd87-4ac0-a00b-63c3f9c19f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:41.863700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-80ff56f1-fd87-4ac0-a00b-63c3f9c19f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:41.895618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1176/2330] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:41.907587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65d1f-f16e-47e0-95bc-1a5bc9a3d9e6 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:41.908529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65d1f-f16e-47e0-95bc-1a5bc9a3d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:41.909346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc65d1f-f16e-47e0-95bc-1a5bc9a3d9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:41.980626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-fbc65d1f-f16e-47e0-95bc-1a5bc9a3d9e6 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:41.983114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-fbc65d1f-f16e-47e0-95bc-1a5bc9a3d9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:42.028781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1177/2331] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:42.043977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc65d1f-f16e-47e0-95bc-1a5bc9a3d9e6 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:42.091503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff56f1-fd87-4ac0-a00b-63c3f9c19f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:42.103045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff56f1-fd87-4ac0-a00b-63c3f9c19f24 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:42.109619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc65d1f-f16e-47e0-95bc-1a5bc9a3d9e6 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:42.135463 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c38b-6af9-4f0a-94a4-5d1afdcf0cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:42.136709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c38b-6af9-4f0a-94a4-5d1afdcf0cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:42.140053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c38b-6af9-4f0a-94a4-5d1afdcf0cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:42.141054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254c38b-6af9-4f0a-94a4-5d1afdcf0cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:42.142927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1155/2332] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:27:42.146190 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254c38b-6af9-4f0a-94a4-5d1afdcf0cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:27:42.148398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254c38b-6af9-4f0a-94a4-5d1afdcf0cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:42.153458 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254c38b-6af9-4f0a-94a4-5d1afdcf0cfc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:42.182336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1178/2333] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:27:42.189315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff56f1-fd87-4ac0-a00b-63c3f9c19f24 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:42.217995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff56f1-fd87-4ac0-a00b-63c3f9c19f24 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:42.238576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def15bcf-f210-45d1-bcd0-f1c695d3fb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:42.239572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def15bcf-f210-45d1-bcd0-f1c695d3fb3d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:42.245773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def15bcf-f210-45d1-bcd0-f1c695d3fb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:42.246571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def15bcf-f210-45d1-bcd0-f1c695d3fb3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:42.247557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def15bcf-f210-45d1-bcd0-f1c695d3fb3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:42.249977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def15bcf-f210-45d1-bcd0-f1c695d3fb3d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:42.342966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1156/2334] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:42 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:42.343850 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c38b-6af9-4f0a-94a4-5d1afdcf0cfc admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:42.362711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254c38b-6af9-4f0a-94a4-5d1afdcf0cfc admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:42.624639 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb9f67-80ce-4c21-9d1e-fd64eb6d69b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:42.625484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb9f67-80ce-4c21-9d1e-fd64eb6d69b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:42.625768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb9f67-80ce-4c21-9d1e-fd64eb6d69b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:42.626117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb9f67-80ce-4c21-9d1e-fd64eb6d69b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:42.627583 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb9f67-80ce-4c21-9d1e-fd64eb6d69b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:42.634349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb9f67-80ce-4c21-9d1e-fd64eb6d69b4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:42.677822 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1179/2335] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:42 2022] POST /identity/v3/users => generated 287 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:27:42.684583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def15bcf-f210-45d1-bcd0-f1c695d3fb3d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:42.717836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def15bcf-f210-45d1-bcd0-f1c695d3fb3d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:42.737064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372c233-3536-4870-83a1-641b97e58c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:42.737768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372c233-3536-4870-83a1-641b97e58c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:42.738050 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372c233-3536-4870-83a1-641b97e58c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:42.738313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372c233-3536-4870-83a1-641b97e58c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:42.739239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372c233-3536-4870-83a1-641b97e58c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:42.745964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372c233-3536-4870-83a1-641b97e58c24 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:42.773770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1157/2336] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:42.774115 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb9f67-80ce-4c21-9d1e-fd64eb6d69b4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:42.805015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb9f67-80ce-4c21-9d1e-fd64eb6d69b4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:42.815058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae3ee8-3142-490d-91fe-fa936e0146a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:42.816111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3ee8-3142-490d-91fe-fa936e0146a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:42.816612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3ee8-3142-490d-91fe-fa936e0146a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:42.817752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae3ee8-3142-490d-91fe-fa936e0146a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:42.819390 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae3ee8-3142-490d-91fe-fa936e0146a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:42.821794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae3ee8-3142-490d-91fe-fa936e0146a7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:42.861091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1180/2337] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:42.866721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372c233-3536-4870-83a1-641b97e58c24 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:42.903525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372c233-3536-4870-83a1-641b97e58c24 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:42.913012 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de39258-a87f-403a-a2fb-82f44c33dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:42.914569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de39258-a87f-403a-a2fb-82f44c33dc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:42.915059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de39258-a87f-403a-a2fb-82f44c33dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:42.915781 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de39258-a87f-403a-a2fb-82f44c33dc74 admin admin] PATH_INFO: `/v3/projects/d4ff8bcade124425a85cc6cd7a86bdb0/users/0aabfe86835d400f99f6043a6f621bdf/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:42.936619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de39258-a87f-403a-a2fb-82f44c33dc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ff8bcade124425a85cc6cd7a86bdb0, user_id=0aabfe86835d400f99f6043a6f621bdf, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:42.939333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de39258-a87f-403a-a2fb-82f44c33dc74 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:42.971305 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1158/2338] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:42 2022] PUT /identity/v3/projects/d4ff8bcade124425a85cc6cd7a86bdb0/users/0aabfe86835d400f99f6043a6f621bdf/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:42.987704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33d793-9257-408a-b932-4659e5b818cb None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:42.988323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33d793-9257-408a-b932-4659e5b818cb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:42.988740 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33d793-9257-408a-b932-4659e5b818cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:43.074523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-3a33d793-9257-408a-b932-4659e5b818cb None None] MFA Rules not processed for user `0aabfe86835d400f99f6043a6f621bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:43.075810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3a33d793-9257-408a-b932-4659e5b818cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:43.276899 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1181/2339] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:43.283279 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de39258-a87f-403a-a2fb-82f44c33dc74 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:43.285729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8de39258-a87f-403a-a2fb-82f44c33dc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:43.387480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de39258-a87f-403a-a2fb-82f44c33dc74 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:43.393059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854982ba-32ed-448d-9c6a-73b3fac914f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:43.393764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854982ba-32ed-448d-9c6a-73b3fac914f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:43.394043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854982ba-32ed-448d-9c6a-73b3fac914f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:43.394372 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854982ba-32ed-448d-9c6a-73b3fac914f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:43.429757 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854982ba-32ed-448d-9c6a-73b3fac914f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:43.433208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854982ba-32ed-448d-9c6a-73b3fac914f6 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:43.451131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1159/2340] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:27:43.485697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33d793-9257-408a-b932-4659e5b818cb None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:43.684382 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33d793-9257-408a-b932-4659e5b818cb None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:43.689401 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:43.690485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:43.690906 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:43.691317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] PATH_INFO: `/v3/users/0aabfe86835d400f99f6043a6f621bdf` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:43.694250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aabfe86835d400f99f6043a6f621bdf)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:43.702683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:43.844814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aabfe86835d400f99f6043a6f621bdf'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:43.854124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aabfe86835d400f99f6043a6f621bdf'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:43.855216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aabfe86835d400f99f6043a6f621bdf'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:43.868419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aabfe86835d400f99f6043a6f621bdf'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:43.904585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aabfe86835d400f99f6043a6f621bdf'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:43.921890 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1182/2341] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:43 2022] DELETE /identity/v3/users/0aabfe86835d400f99f6043a6f621bdf => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:43.925259 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdfbe0-fa2d-4f49-9318-0a32db5e1a0f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:43.927195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdfbe0-fa2d-4f49-9318-0a32db5e1a0f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:43.927954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdfbe0-fa2d-4f49-9318-0a32db5e1a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:43.988601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7dbdfbe0-fa2d-4f49-9318-0a32db5e1a0f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:43.990780 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7dbdfbe0-fa2d-4f49-9318-0a32db5e1a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:44.169042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1160/2342] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:44.181470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:44.182968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:44.399131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea6e47-5f85-4259-abe8-5e2093418680 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:44.411784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22b07f-3051-4ee7-8f7d-30a6471d4a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:44.412823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22b07f-3051-4ee7-8f7d-30a6471d4a1f service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:44.414452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22b07f-3051-4ee7-8f7d-30a6471d4a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:44.415631 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22b07f-3051-4ee7-8f7d-30a6471d4a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:44.456989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22b07f-3051-4ee7-8f7d-30a6471d4a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:44.457881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22b07f-3051-4ee7-8f7d-30a6471d4a1f service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:44.480728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1183/2343] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:45.341749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdfbe0-fa2d-4f49-9318-0a32db5e1a0f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:45.353962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7dbdfbe0-fa2d-4f49-9318-0a32db5e1a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:45.410641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdfbe0-fa2d-4f49-9318-0a32db5e1a0f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:45.421641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:45.424294 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:45.424947 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:45.425871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] PATH_INFO: `/v3/projects/d4ff8bcade124425a85cc6cd7a86bdb0` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:45.428214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ff8bcade124425a85cc6cd7a86bdb0)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:45.433518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:45.621166 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ff8bcade124425a85cc6cd7a86bdb0', 'request_id': 'req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:45.653190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ff8bcade124425a85cc6cd7a86bdb0', 'request_id': 'req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:45.671661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ff8bcade124425a85cc6cd7a86bdb0', 'request_id': 'req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:45.702706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] The token cache is being invalidate because project d4ff8bcade124425a85cc6cd7a86bdb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:45.704186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:45.706061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1ec4c139-2b0b-4ab0-b716-7e6ef56ced65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:45.709107 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1161/2344] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:45 2022] DELETE /identity/v3/projects/d4ff8bcade124425a85cc6cd7a86bdb0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:45.720141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464468b2-847f-4633-bfef-196a779e6202 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:45.720141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464468b2-847f-4633-bfef-196a779e6202 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:45.729771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464468b2-847f-4633-bfef-196a779e6202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:45.779235 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-464468b2-847f-4633-bfef-196a779e6202 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:45.786342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-464468b2-847f-4633-bfef-196a779e6202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:46.067526 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1184/2345] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:46.082907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9529195-d1c1-45de-92c0-fae12f4c8981 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:46.083187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9529195-d1c1-45de-92c0-fae12f4c8981 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:46.083676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9529195-d1c1-45de-92c0-fae12f4c8981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:46.162884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d9529195-d1c1-45de-92c0-fae12f4c8981 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:46.165687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d9529195-d1c1-45de-92c0-fae12f4c8981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:46.190990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1162/2346] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:46.195655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464468b2-847f-4633-bfef-196a779e6202 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:46.228670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464468b2-847f-4633-bfef-196a779e6202 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:46.246709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a0441-a7a7-47a1-8fe6-b4a09e38a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:46.247822 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a0441-a7a7-47a1-8fe6-b4a09e38a1ca admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:46.248246 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a0441-a7a7-47a1-8fe6-b4a09e38a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:46.248671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a0441-a7a7-47a1-8fe6-b4a09e38a1ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:46.249907 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a0441-a7a7-47a1-8fe6-b4a09e38a1ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:27:46.250426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a0441-a7a7-47a1-8fe6-b4a09e38a1ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:46.254558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a0441-a7a7-47a1-8fe6-b4a09e38a1ca admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:46.283415 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1185/2347] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:27:46.293924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9529195-d1c1-45de-92c0-fae12f4c8981 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:46.319288 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9529195-d1c1-45de-92c0-fae12f4c8981 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:46.333570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d26c70-a697-48b7-8343-9831bc101ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:46.337164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d26c70-a697-48b7-8343-9831bc101ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:46.337780 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d26c70-a697-48b7-8343-9831bc101ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:46.338260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d26c70-a697-48b7-8343-9831bc101ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:46.340729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d26c70-a697-48b7-8343-9831bc101ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:46.364575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d26c70-a697-48b7-8343-9831bc101ac1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:46.455643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1163/2348] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:27:46 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:27:46.461896 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a0441-a7a7-47a1-8fe6-b4a09e38a1ca admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:46.484975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a0441-a7a7-47a1-8fe6-b4a09e38a1ca admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:46.620866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c9b0-b9a3-4bc6-9124-0287757d661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:46.621863 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c9b0-b9a3-4bc6-9124-0287757d661c admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:46.622341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c9b0-b9a3-4bc6-9124-0287757d661c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:46.622782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c9b0-b9a3-4bc6-9124-0287757d661c admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:46.624037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c9b0-b9a3-4bc6-9124-0287757d661c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:46.628320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c9b0-b9a3-4bc6-9124-0287757d661c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:46.664329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1186/2349] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:27:46 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:27:46.669971 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d26c70-a697-48b7-8343-9831bc101ac1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:46.688553 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d26c70-a697-48b7-8343-9831bc101ac1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:46.697706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ee125-4f3b-435f-9572-a4fea98dedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:46.699345 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ee125-4f3b-435f-9572-a4fea98dedf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:46.700068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ee125-4f3b-435f-9572-a4fea98dedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:46.701737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ee125-4f3b-435f-9572-a4fea98dedf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:46.704586 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ee125-4f3b-435f-9572-a4fea98dedf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:46.709278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ee125-4f3b-435f-9572-a4fea98dedf9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:46.732075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1164/2350] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:27:46.737988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c9b0-b9a3-4bc6-9124-0287757d661c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:46.774311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c9b0-b9a3-4bc6-9124-0287757d661c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:46.809856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2cbd4-2e06-4968-89b0-1df87bb87179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:46.812373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2cbd4-2e06-4968-89b0-1df87bb87179 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:46.813066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2cbd4-2e06-4968-89b0-1df87bb87179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:46.813883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2cbd4-2e06-4968-89b0-1df87bb87179 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:46.815893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2cbd4-2e06-4968-89b0-1df87bb87179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:46.819561 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2cbd4-2e06-4968-89b0-1df87bb87179 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:46.844871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1187/2351] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:27:46.850904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ee125-4f3b-435f-9572-a4fea98dedf9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:46.885613 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ee125-4f3b-435f-9572-a4fea98dedf9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:46.917689 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff411db9-2929-42e9-9cdd-48dedf9b9aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:46.920038 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff411db9-2929-42e9-9cdd-48dedf9b9aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:46.921861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff411db9-2929-42e9-9cdd-48dedf9b9aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:46.922325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff411db9-2929-42e9-9cdd-48dedf9b9aa6 admin admin] PATH_INFO: `/v3/projects/517c054d4f9a45a7b4ad85f0a1dc314c/users/9cc070e03a414e139ea18ee56963b53c/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:46.991103 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff411db9-2929-42e9-9cdd-48dedf9b9aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517c054d4f9a45a7b4ad85f0a1dc314c, user_id=9cc070e03a414e139ea18ee56963b53c, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:47.002533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff411db9-2929-42e9-9cdd-48dedf9b9aa6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:47.041780 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1165/2352] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:27:46 2022] PUT /identity/v3/projects/517c054d4f9a45a7b4ad85f0a1dc314c/users/9cc070e03a414e139ea18ee56963b53c/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:47.056844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337a7a-3118-46b6-af9f-0f471c69dde6 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:47.057410 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337a7a-3118-46b6-af9f-0f471c69dde6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:47.057985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4337a7a-3118-46b6-af9f-0f471c69dde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:47.146375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e4337a7a-3118-46b6-af9f-0f471c69dde6 None None] MFA Rules not processed for user `9cc070e03a414e139ea18ee56963b53c`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:47.147789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e4337a7a-3118-46b6-af9f-0f471c69dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:47.382843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1188/2353] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:47.418915 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff411db9-2929-42e9-9cdd-48dedf9b9aa6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:47.420830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ff411db9-2929-42e9-9cdd-48dedf9b9aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:47.561773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff411db9-2929-42e9-9cdd-48dedf9b9aa6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:47.581029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ee2bf-ad9c-4c42-b565-84ab256820b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:47.583627 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ee2bf-ad9c-4c42-b565-84ab256820b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:47.584626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ee2bf-ad9c-4c42-b565-84ab256820b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:47.585722 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ee2bf-ad9c-4c42-b565-84ab256820b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:47.615997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ee2bf-ad9c-4c42-b565-84ab256820b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:47.619382 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ee2bf-ad9c-4c42-b565-84ab256820b9 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:47.647823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1166/2354] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:48.164810 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4337a7a-3118-46b6-af9f-0f471c69dde6 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:48.168289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e4337a7a-3118-46b6-af9f-0f471c69dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:48.621142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4337a7a-3118-46b6-af9f-0f471c69dde6 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:48.640778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:48.648660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:48.651599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:48.653108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] PATH_INFO: `/v3/users/b5e833f99db348e49c3533490b1e4023` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:48.659896 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e833f99db348e49c3533490b1e4023)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:48.667576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:48.822035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e833f99db348e49c3533490b1e4023'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:48.861849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e833f99db348e49c3533490b1e4023'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:48.863961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e833f99db348e49c3533490b1e4023'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:48.887548 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e833f99db348e49c3533490b1e4023'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:48.935302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e833f99db348e49c3533490b1e4023'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:48.947383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1189/2355] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:48 2022] DELETE /identity/v3/users/b5e833f99db348e49c3533490b1e4023 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:48.952667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4c43f-a507-4a57-a946-b9201a6c15d6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:48.955226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4c43f-a507-4a57-a946-b9201a6c15d6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:48.956135 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4c43f-a507-4a57-a946-b9201a6c15d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:48.988543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2ef4c43f-a507-4a57-a946-b9201a6c15d6 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:48.993210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2ef4c43f-a507-4a57-a946-b9201a6c15d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:49.165535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1167/2356] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:49.167538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:49.170124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:49.342829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254f87-25d0-4a07-b923-067c5787caf9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:49.350061 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47875c8-5481-42a7-b95a-0081f124dcb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:49.351584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47875c8-5481-42a7-b95a-0081f124dcb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:49.352350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47875c8-5481-42a7-b95a-0081f124dcb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:49.353205 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47875c8-5481-42a7-b95a-0081f124dcb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:49.401945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47875c8-5481-42a7-b95a-0081f124dcb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:49.411251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47875c8-5481-42a7-b95a-0081f124dcb7 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:49.433754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4c43f-a507-4a57-a946-b9201a6c15d6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:49.435664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2ef4c43f-a507-4a57-a946-b9201a6c15d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:49.471474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1190/2357] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:27:49.504972 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4c43f-a507-4a57-a946-b9201a6c15d6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:49.525203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:49.526782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:49.527262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:49.527742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] PATH_INFO: `/v3/users/8440f364fd324069af57a305c935d16c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:49.536565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8440f364fd324069af57a305c935d16c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:49.546484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:49.671941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8440f364fd324069af57a305c935d16c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:49.691870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8440f364fd324069af57a305c935d16c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:49.723549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8440f364fd324069af57a305c935d16c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:49.724370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8440f364fd324069af57a305c935d16c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:49.737919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c13df4bd-6e9c-478a-915b-4d2df165ba25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8440f364fd324069af57a305c935d16c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:49.764058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bc241-d126-4090-97d4-40d01ee7ea55 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:49.764402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bc241-d126-4090-97d4-40d01ee7ea55 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:49.764609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bc241-d126-4090-97d4-40d01ee7ea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:49.782150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1168/2358] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:49 2022] DELETE /identity/v3/users/8440f364fd324069af57a305c935d16c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:27:49.798847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa9ec1-5bb7-4b45-aeee-b0f8acde58c1 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:49.799699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa9ec1-5bb7-4b45-aeee-b0f8acde58c1 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:49.800270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa9ec1-5bb7-4b45-aeee-b0f8acde58c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:49.801870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4e3bc241-d126-4090-97d4-40d01ee7ea55 None None] MFA Rules not processed for user `9cc070e03a414e139ea18ee56963b53c`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:49.805196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4e3bc241-d126-4090-97d4-40d01ee7ea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:49.871294 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-6afa9ec1-5bb7-4b45-aeee-b0f8acde58c1 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:49.872548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6afa9ec1-5bb7-4b45-aeee-b0f8acde58c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:49.951114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1191/2359] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:27:50.019481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1169/2360] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:27:50.044057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bc241-d126-4090-97d4-40d01ee7ea55 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:50.054538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4e3bc241-d126-4090-97d4-40d01ee7ea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:50.213758 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bc241-d126-4090-97d4-40d01ee7ea55 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:50.227394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4ca3-adce-4ed8-830e-6aed80148d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:50.227394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4ca3-adce-4ed8-830e-6aed80148d73 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:50.227394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4ca3-adce-4ed8-830e-6aed80148d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:50.227394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4ca3-adce-4ed8-830e-6aed80148d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:50.261260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd4ca3-adce-4ed8-830e-6aed80148d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:50.267651 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd4ca3-adce-4ed8-830e-6aed80148d73 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:50.284725 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1192/2361] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:50.742621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef71f5-6b57-4e0f-90ec-efff8aa6a720 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:50.743002 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef71f5-6b57-4e0f-90ec-efff8aa6a720 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:50.743513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef71f5-6b57-4e0f-90ec-efff8aa6a720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:50.795287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-22ef71f5-6b57-4e0f-90ec-efff8aa6a720 None None] MFA Rules not processed for user `c803c9435431420793f121bf7a7f0376`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:27:50.799472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-22ef71f5-6b57-4e0f-90ec-efff8aa6a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:50.835682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4ca3-adce-4ed8-830e-6aed80148d73 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:50.837554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-93cd4ca3-adce-4ed8-830e-6aed80148d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:50.861466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4ca3-adce-4ed8-830e-6aed80148d73 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:50.874944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:50.875751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:50.876026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:50.882591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] PATH_INFO: `/v3/projects/ae7f0f1c7f4e49dfb85a141be2fa2c62` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:50.884322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7f0f1c7f4e49dfb85a141be2fa2c62)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:50.887478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:50.985423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7f0f1c7f4e49dfb85a141be2fa2c62', 'request_id': 'req-ac874699-639b-4c00-96f4-678dff7379ef'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:50.993698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7f0f1c7f4e49dfb85a141be2fa2c62', 'request_id': 'req-ac874699-639b-4c00-96f4-678dff7379ef'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.005258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1170/2362] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:27:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:27:51.010656 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7f0f1c7f4e49dfb85a141be2fa2c62', 'request_id': 'req-ac874699-639b-4c00-96f4-678dff7379ef'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.043825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] The token cache is being invalidate because project ae7f0f1c7f4e49dfb85a141be2fa2c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:51.044814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.049281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.057666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1193/2363] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:50 2022] DELETE /identity/v3/projects/ae7f0f1c7f4e49dfb85a141be2fa2c62 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:51.066105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef71f5-6b57-4e0f-90ec-efff8aa6a720 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:51.080631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef71f5-6b57-4e0f-90ec-efff8aa6a720 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:51.132162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:51.134556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:51.218067 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:51.219364 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:51.219771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:51.220157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] PATH_INFO: `/v3/users/740bc5cbba314ce48ea1f2fd286a63cf` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:51.221919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] RBAC: Authorizing `identity:delete_user(user_id=740bc5cbba314ce48ea1f2fd286a63cf)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:51.224963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:51.303944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874699-639b-4c00-96f4-678dff7379ef admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:51.312341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:51.313960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:51.314438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:51.314905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] PATH_INFO: `/v3/projects/4f18e9b323194d6eb7b2eb68a04ae289` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:51.316419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f18e9b323194d6eb7b2eb68a04ae289)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:51.318609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:51.328046 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740bc5cbba314ce48ea1f2fd286a63cf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.345182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740bc5cbba314ce48ea1f2fd286a63cf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.371764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740bc5cbba314ce48ea1f2fd286a63cf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.373203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740bc5cbba314ce48ea1f2fd286a63cf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.399062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740bc5cbba314ce48ea1f2fd286a63cf'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.408148 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1171/2364] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:51 2022] DELETE /identity/v3/users/740bc5cbba314ce48ea1f2fd286a63cf => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:51.415347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:51.417700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:51.428352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f18e9b323194d6eb7b2eb68a04ae289', 'request_id': 'req-8c30096e-f857-40bb-8ce3-ffc09f947eb5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.473435 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f18e9b323194d6eb7b2eb68a04ae289', 'request_id': 'req-8c30096e-f857-40bb-8ce3-ffc09f947eb5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.513672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f18e9b323194d6eb7b2eb68a04ae289', 'request_id': 'req-8c30096e-f857-40bb-8ce3-ffc09f947eb5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.563519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] The token cache is being invalidate because project 4f18e9b323194d6eb7b2eb68a04ae289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:51.563519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.566245 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:51.585362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1194/2365] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:51 2022] DELETE /identity/v3/projects/4f18e9b323194d6eb7b2eb68a04ae289 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:51.692601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd0419-fa75-4dc6-9931-6673b501402e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:51.708691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfa693-1000-460d-a994-068be46c585c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:51.710541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfa693-1000-460d-a994-068be46c585c service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:51.711631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfa693-1000-460d-a994-068be46c585c service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:51.712821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfa693-1000-460d-a994-068be46c585c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:51.718796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6bcfa693-1000-460d-a994-068be46c585c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:51.859538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfa693-1000-460d-a994-068be46c585c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:51.868771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfa693-1000-460d-a994-068be46c585c service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:51.893475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1172/2366] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:27:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:27:52.244412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:52.246860 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:52.365120 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30096e-f857-40bb-8ce3-ffc09f947eb5 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:52.506531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:52.507790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:52.508226 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:52.508672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] PATH_INFO: `/v3/projects/23055406f1a449229f38aa2746318b38` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:52.510263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23055406f1a449229f38aa2746318b38)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:52.512372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:52.610705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23055406f1a449229f38aa2746318b38', 'request_id': 'req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:52.621687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23055406f1a449229f38aa2746318b38', 'request_id': 'req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:52.633883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23055406f1a449229f38aa2746318b38', 'request_id': 'req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:52.665105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] The token cache is being invalidate because project 23055406f1a449229f38aa2746318b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:52.665687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:52.669081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:52.687876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1195/2367] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:52 2022] DELETE /identity/v3/projects/23055406f1a449229f38aa2746318b38 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:52.692659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfa693-1000-460d-a994-068be46c585c service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:52.717771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfa693-1000-460d-a994-068be46c585c service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:52.847912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:52.849055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:52.850043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:52.850515 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] PATH_INFO: `/v3/users/133c925392bd4bc19032a003c7f27822` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:52.852235 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133c925392bd4bc19032a003c7f27822)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:52.854924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:52.947479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133c925392bd4bc19032a003c7f27822'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:52.962402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133c925392bd4bc19032a003c7f27822'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:52.994214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133c925392bd4bc19032a003c7f27822'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:52.995700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133c925392bd4bc19032a003c7f27822'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:53.034377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-7adcd0d0-35e4-4d62-886a-a18a3644b104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133c925392bd4bc19032a003c7f27822'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:53.054897 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1173/2368] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:27:52 2022] DELETE /identity/v3/users/133c925392bd4bc19032a003c7f27822 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:27:53.657632 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:27:53.663909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:27:53.710791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f78bb9-b0da-411a-bcea-b8c29e64b7e1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:27:53.894478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:27:53.895779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:27:53.896693 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:27:53.897201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] PATH_INFO: `/v3/projects/2d7036ffd9684b819a431dbf435f64f7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:27:53.900264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7036ffd9684b819a431dbf435f64f7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:27:53.903981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:27:53.996838 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7036ffd9684b819a431dbf435f64f7', 'request_id': 'req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:54.038888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7036ffd9684b819a431dbf435f64f7', 'request_id': 'req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:54.068990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7036ffd9684b819a431dbf435f64f7', 'request_id': 'req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:54.131410 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] The token cache is being invalidate because project 2d7036ffd9684b819a431dbf435f64f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:27:54.132212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:54.133969 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:27:54.157745 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1196/2369] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:27:53 2022] DELETE /identity/v3/projects/2d7036ffd9684b819a431dbf435f64f7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:08.036097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eb782-f1cb-43ad-92b2-470c6e604ca5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:08.036926 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eb782-f1cb-43ad-92b2-470c6e604ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:08.037199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eb782-f1cb-43ad-92b2-470c6e604ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:08.091255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4f9eb782-f1cb-43ad-92b2-470c6e604ca5 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:08.093424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4f9eb782-f1cb-43ad-92b2-470c6e604ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:08.208256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1174/2370] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:28:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:28:08.281542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:08.283270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:08.393046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b001a2e-d0dc-42b8-92a6-cf3cf542ccd2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:08.402294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357487f7-5979-45b9-9e22-cda389e64a54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:08.403307 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357487f7-5979-45b9-9e22-cda389e64a54 service swift] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:08.403773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357487f7-5979-45b9-9e22-cda389e64a54 service swift] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:08.404251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357487f7-5979-45b9-9e22-cda389e64a54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:08.437851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357487f7-5979-45b9-9e22-cda389e64a54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:08.441162 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357487f7-5979-45b9-9e22-cda389e64a54 service swift] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:08.456543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1197/2371] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:28:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:14.818313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eb782-f1cb-43ad-92b2-470c6e604ca5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:14.820284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4f9eb782-f1cb-43ad-92b2-470c6e604ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:15.063902 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eb782-f1cb-43ad-92b2-470c6e604ca5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:15.072636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354e4c9-b571-4f62-b98e-de512137adfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac3e041554a4439bfa91520e52fbd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:15.073596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354e4c9-b571-4f62-b98e-de512137adfa service placement] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:15.080571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354e4c9-b571-4f62-b98e-de512137adfa service placement] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:15.082114 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354e4c9-b571-4f62-b98e-de512137adfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:15.084824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c354e4c9-b571-4f62-b98e-de512137adfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:15.137595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354e4c9-b571-4f62-b98e-de512137adfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:15.140217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354e4c9-b571-4f62-b98e-de512137adfa service placement] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:15.156710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1175/2372] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:28:17.020191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4abc0-bbbc-453c-b75a-eb55eb2c4628 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:17.020912 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4abc0-bbbc-453c-b75a-eb55eb2c4628 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:17.021182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4abc0-bbbc-453c-b75a-eb55eb2c4628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:17.045703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-28f4abc0-bbbc-453c-b75a-eb55eb2c4628 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:17.047075 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-28f4abc0-bbbc-453c-b75a-eb55eb2c4628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:17.083967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1198/2373] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:17.101189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354e4c9-b571-4f62-b98e-de512137adfa service placement] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:17.115777 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354e4c9-b571-4f62-b98e-de512137adfa service placement] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:17.124740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fa6a6-83d7-4ea5-bf47-e907cd7cfac1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:17.128418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fa6a6-83d7-4ea5-bf47-e907cd7cfac1 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:17.128418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fa6a6-83d7-4ea5-bf47-e907cd7cfac1 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:17.128418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fa6a6-83d7-4ea5-bf47-e907cd7cfac1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:17.148404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64fa6a6-83d7-4ea5-bf47-e907cd7cfac1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:17.151315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64fa6a6-83d7-4ea5-bf47-e907cd7cfac1 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:17.164176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1176/2374] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:18.041750 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f5a1-58e3-4a54-a701-0a953f2bd216 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:18.042661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f5a1-58e3-4a54-a701-0a953f2bd216 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:18.043097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f5a1-58e3-4a54-a701-0a953f2bd216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:18.067177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-5af3f5a1-58e3-4a54-a701-0a953f2bd216 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:18.068426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5af3f5a1-58e3-4a54-a701-0a953f2bd216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:18.077198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1199/2375] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jan 28 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:18.106144 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fa6a6-83d7-4ea5-bf47-e907cd7cfac1 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:18.123447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fa6a6-83d7-4ea5-bf47-e907cd7cfac1 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:18.133474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ffc6-eeae-4817-b3d9-28e330687959 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:18.134243 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ffc6-eeae-4817-b3d9-28e330687959 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:18.134670 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ffc6-eeae-4817-b3d9-28e330687959 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:18.135091 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ffc6-eeae-4817-b3d9-28e330687959 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:18.148021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686ffc6-eeae-4817-b3d9-28e330687959 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:18.151481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686ffc6-eeae-4817-b3d9-28e330687959 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:18.165973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1177/2376] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:28:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:18.482110 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fbc12-5021-4db6-97b6-50917519727a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:18.483709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fbc12-5021-4db6-97b6-50917519727a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:18.484228 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fbc12-5021-4db6-97b6-50917519727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:18.547827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1a1fbc12-5021-4db6-97b6-50917519727a None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:18.550621 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1a1fbc12-5021-4db6-97b6-50917519727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:18.564450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1200/2377] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:18.586115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ffc6-eeae-4817-b3d9-28e330687959 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:18.605915 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ffc6-eeae-4817-b3d9-28e330687959 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:18.629993 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a48f85-5499-42a3-8ab5-db86d763d79e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:18.632260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a48f85-5499-42a3-8ab5-db86d763d79e service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:18.633007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a48f85-5499-42a3-8ab5-db86d763d79e service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:18.633973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a48f85-5499-42a3-8ab5-db86d763d79e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:18.660486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a48f85-5499-42a3-8ab5-db86d763d79e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:18.664735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a48f85-5499-42a3-8ab5-db86d763d79e service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:18.684365 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1178/2378] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:28:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:19.435823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521167-a16f-404d-9fd1-6cfcc343abbd None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:19.436593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521167-a16f-404d-9fd1-6cfcc343abbd None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:19.436593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521167-a16f-404d-9fd1-6cfcc343abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:19.465407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b7521167-a16f-404d-9fd1-6cfcc343abbd None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:19.466671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b7521167-a16f-404d-9fd1-6cfcc343abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:19.478623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1201/2379] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jan 28 01:28:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:19.495292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a6731-5e17-4f6e-bbc0-6d2d1dd94ee0 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:19.496074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a6731-5e17-4f6e-bbc0-6d2d1dd94ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:19.496074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a6731-5e17-4f6e-bbc0-6d2d1dd94ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:19.520794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7521167-a16f-404d-9fd1-6cfcc343abbd None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:19.522847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4f8a6731-5e17-4f6e-bbc0-6d2d1dd94ee0 None None] MFA Rules not processed for user `6b11396acc67415abb08ddddf5680df8`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:19.524598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4f8a6731-5e17-4f6e-bbc0-6d2d1dd94ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:19.541922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7521167-a16f-404d-9fd1-6cfcc343abbd None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:19.552878 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80defbbd-5249-43f5-90ec-d24d60f9f4e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:19.555331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80defbbd-5249-43f5-90ec-d24d60f9f4e7 service swift] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:19.555965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80defbbd-5249-43f5-90ec-d24d60f9f4e7 service swift] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:19.556472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80defbbd-5249-43f5-90ec-d24d60f9f4e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:19.567224 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80defbbd-5249-43f5-90ec-d24d60f9f4e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:19.569309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80defbbd-5249-43f5-90ec-d24d60f9f4e7 service swift] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:19.583970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1202/2380] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:28:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:19.708604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1179/2381] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:22.506815 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80defbbd-5249-43f5-90ec-d24d60f9f4e7 service swift] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:22.508300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-80defbbd-5249-43f5-90ec-d24d60f9f4e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:22.669325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80defbbd-5249-43f5-90ec-d24d60f9f4e7 service swift] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:22.679015 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:22.681246 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:22.682080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:22.682587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] PATH_INFO: `/v3/users/9cc070e03a414e139ea18ee56963b53c` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:22.685937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc070e03a414e139ea18ee56963b53c)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:22.690865 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:22.802857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc070e03a414e139ea18ee56963b53c'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:22.821832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc070e03a414e139ea18ee56963b53c'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:22.824081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc070e03a414e139ea18ee56963b53c'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:22.844684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc070e03a414e139ea18ee56963b53c'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:22.864901 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc070e03a414e139ea18ee56963b53c'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:22.882765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1203/2382] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:28:22 2022] DELETE /identity/v3/users/9cc070e03a414e139ea18ee56963b53c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:22.894114 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fea48-950d-4b8a-b06b-56b4a738d951 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:22.895064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fea48-950d-4b8a-b06b-56b4a738d951 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:22.895504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fea48-950d-4b8a-b06b-56b4a738d951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:22.920444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e42fea48-950d-4b8a-b06b-56b4a738d951 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:22.942753 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e42fea48-950d-4b8a-b06b-56b4a738d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:23.060714 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1180/2383] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:23.072364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:23.074544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:23.163942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd455e7c-1a90-4eea-a565-6ecccf038775 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:23.169270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bbc52-64ee-4c5f-ac77-6d9733ceaefa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:23.174569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bbc52-64ee-4c5f-ac77-6d9733ceaefa service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:23.174569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bbc52-64ee-4c5f-ac77-6d9733ceaefa service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:23.174569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bbc52-64ee-4c5f-ac77-6d9733ceaefa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:23.190637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bbc52-64ee-4c5f-ac77-6d9733ceaefa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:23.192702 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bbc52-64ee-4c5f-ac77-6d9733ceaefa service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:23.217520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1204/2384] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:28:23.432125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fea48-950d-4b8a-b06b-56b4a738d951 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:23.434762 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e42fea48-950d-4b8a-b06b-56b4a738d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:23.454530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fea48-950d-4b8a-b06b-56b4a738d951 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:23.484698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:23.485837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:23.486111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:23.486385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] PATH_INFO: `/v3/projects/517c054d4f9a45a7b4ad85f0a1dc314c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:23.487749 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=517c054d4f9a45a7b4ad85f0a1dc314c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:23.489821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:23.549569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517c054d4f9a45a7b4ad85f0a1dc314c', 'request_id': 'req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:23.561466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517c054d4f9a45a7b4ad85f0a1dc314c', 'request_id': 'req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:23.576128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517c054d4f9a45a7b4ad85f0a1dc314c', 'request_id': 'req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:23.591131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] The token cache is being invalidate because project 517c054d4f9a45a7b4ad85f0a1dc314c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:28:23.591274 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:23.592112 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c22ef6b2-04c7-4839-aa06-98e4b428dfcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:23.609264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1181/2385] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:28:23 2022] DELETE /identity/v3/projects/517c054d4f9a45a7b4ad85f0a1dc314c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:29.997040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91849f5e-c0b6-4bd1-96e0-7a0313211ffd None None] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:29.998049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91849f5e-c0b6-4bd1-96e0-7a0313211ffd None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:29.998709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91849f5e-c0b6-4bd1-96e0-7a0313211ffd None None] PATH_INFO: `/` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:30.000697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1205/2386] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jan 28 01:28:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:28:30.014234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb465b6-641f-475f-afe5-b24ad09e2f78 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:30.015570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb465b6-641f-475f-afe5-b24ad09e2f78 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:30.015868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb465b6-641f-475f-afe5-b24ad09e2f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:30.098852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2cb465b6-641f-475f-afe5-b24ad09e2f78 None None] MFA Rules not processed for user `43dd173265f24c69af4b13b61722eb51`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:30.106340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2cb465b6-641f-475f-afe5-b24ad09e2f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:30.196464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1182/2387] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jan 28 01:28:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:30.211861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91849f5e-c0b6-4bd1-96e0-7a0313211ffd None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:30.214053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-91849f5e-c0b6-4bd1-96e0-7a0313211ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:30.324720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91849f5e-c0b6-4bd1-96e0-7a0313211ffd None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:30.330709 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9682b01-431d-4394-8d56-1da5998f4f24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec2950259d4ed0925d7a19a6217af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:30.331617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682b01-431d-4394-8d56-1da5998f4f24 service glance] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:30.332084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682b01-431d-4394-8d56-1da5998f4f24 service glance] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:30.332628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682b01-431d-4394-8d56-1da5998f4f24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:30.349409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9682b01-431d-4394-8d56-1da5998f4f24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:30.351950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9682b01-431d-4394-8d56-1da5998f4f24 service glance] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:30.363539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1206/2388] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:28:30.446006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc530ea5-3082-4bde-a9d2-587d5fc1851e None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:30.446317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc530ea5-3082-4bde-a9d2-587d5fc1851e None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:30.446768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc530ea5-3082-4bde-a9d2-587d5fc1851e None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:30.449661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1183/2389] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jan 28 01:28:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 28 01:28:30.457648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd7557-3f87-4cfd-a1c7-893aa5833f28 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:30.458085 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd7557-3f87-4cfd-a1c7-893aa5833f28 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:30.458521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd7557-3f87-4cfd-a1c7-893aa5833f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:30.480661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-40fd7557-3f87-4cfd-a1c7-893aa5833f28 None None] MFA Rules not processed for user `84470027e2824dc3a4b735d086de1300`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:30.481844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-40fd7557-3f87-4cfd-a1c7-893aa5833f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:30.534859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1207/2390] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jan 28 01:28:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:30.547593 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc530ea5-3082-4bde-a9d2-587d5fc1851e None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:30.549475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dc530ea5-3082-4bde-a9d2-587d5fc1851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:30.562757 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc530ea5-3082-4bde-a9d2-587d5fc1851e None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:30.566732 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5c739-f20a-4465-8c00-4d2e8a40128b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:30.567363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5c739-f20a-4465-8c00-4d2e8a40128b service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:30.567637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5c739-f20a-4465-8c00-4d2e8a40128b service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:30.567904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5c739-f20a-4465-8c00-4d2e8a40128b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:30.575466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5c739-f20a-4465-8c00-4d2e8a40128b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:30.576958 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5c739-f20a-4465-8c00-4d2e8a40128b service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:30.585333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1184/2391] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:28:33.887278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a95a28-11fc-48ab-a952-f968e0278775 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:33.888573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a95a28-11fc-48ab-a952-f968e0278775 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:33.889106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a95a28-11fc-48ab-a952-f968e0278775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:33.919706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-30a95a28-11fc-48ab-a952-f968e0278775 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:33.921424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-30a95a28-11fc-48ab-a952-f968e0278775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:34.018178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1208/2392] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:28:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:34.044346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5c739-f20a-4465-8c00-4d2e8a40128b service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:34.046458 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-01f5c739-f20a-4465-8c00-4d2e8a40128b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:34.147979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5c739-f20a-4465-8c00-4d2e8a40128b service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:34.153850 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae2187-e16f-4c42-afa9-09d7afde519a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:34.154513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae2187-e16f-4c42-afa9-09d7afde519a service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:34.154798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae2187-e16f-4c42-afa9-09d7afde519a service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:34.155070 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae2187-e16f-4c42-afa9-09d7afde519a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:34.165954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae2187-e16f-4c42-afa9-09d7afde519a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:34.167109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae2187-e16f-4c42-afa9-09d7afde519a service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:34.176190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1185/2393] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:28:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 01:28:47.982681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a95a28-11fc-48ab-a952-f968e0278775 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:47.984201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-30a95a28-11fc-48ab-a952-f968e0278775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:48.083007 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a95a28-11fc-48ab-a952-f968e0278775 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:48.089357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:48.089875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:48.090220 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:48.090441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] PATH_INFO: `/v3/users/bdd86efb97ad48a994f04304a8459e54` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:48.092241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd86efb97ad48a994f04304a8459e54)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:48.094374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:48.183476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd86efb97ad48a994f04304a8459e54'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:48.199133 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd86efb97ad48a994f04304a8459e54'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:48.200095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd86efb97ad48a994f04304a8459e54'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:48.213371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd86efb97ad48a994f04304a8459e54'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:48.231019 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5a9baab3-a61a-4615-b8ae-f09d9dbe5ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd86efb97ad48a994f04304a8459e54'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:48.246208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1209/2394] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:28:47 2022] DELETE /identity/v3/users/bdd86efb97ad48a994f04304a8459e54 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:48.484021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae2187-e16f-4c42-afa9-09d7afde519a service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:48.497659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae2187-e16f-4c42-afa9-09d7afde519a service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:48.565855 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:48.568006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:48.568006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:48.568006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] PATH_INFO: `/v3/projects/945f13b911d24a89a9d374a503d05cbb` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:48.568946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945f13b911d24a89a9d374a503d05cbb)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:48.570615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:48.621833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945f13b911d24a89a9d374a503d05cbb', 'request_id': 'req-ea17cb57-3034-4b60-99af-1d6dbef426e4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:48.631051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945f13b911d24a89a9d374a503d05cbb', 'request_id': 'req-ea17cb57-3034-4b60-99af-1d6dbef426e4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:48.638392 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945f13b911d24a89a9d374a503d05cbb', 'request_id': 'req-ea17cb57-3034-4b60-99af-1d6dbef426e4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:48.650905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] The token cache is being invalidate because project 945f13b911d24a89a9d374a503d05cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:28:48.651194 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:48.652252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ea17cb57-3034-4b60-99af-1d6dbef426e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:48.654015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1186/2395] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:28:48 2022] DELETE /identity/v3/projects/945f13b911d24a89a9d374a503d05cbb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:48.660475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b5965-ef31-42bd-a53d-d88ee7b8aa37 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:48.660766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b5965-ef31-42bd-a53d-d88ee7b8aa37 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:48.661038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b5965-ef31-42bd-a53d-d88ee7b8aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:48.682219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e86b5965-ef31-42bd-a53d-d88ee7b8aa37 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:48.683444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e86b5965-ef31-42bd-a53d-d88ee7b8aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:48.759644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1210/2396] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:48.767431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2932c-bee7-48e0-bdbc-f73ee684cc3b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:48.767710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2932c-bee7-48e0-bdbc-f73ee684cc3b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:48.767981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2932c-bee7-48e0-bdbc-f73ee684cc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:48.786659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-39f2932c-bee7-48e0-bdbc-f73ee684cc3b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:48.787843 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-39f2932c-bee7-48e0-bdbc-f73ee684cc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:48.796068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1187/2397] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:48.800432 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b5965-ef31-42bd-a53d-d88ee7b8aa37 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:48.810640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b5965-ef31-42bd-a53d-d88ee7b8aa37 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:48.816154 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769ad4c-4198-4ca0-9e65-665ce43c5445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:48.816826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769ad4c-4198-4ca0-9e65-665ce43c5445 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:48.817135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769ad4c-4198-4ca0-9e65-665ce43c5445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:48.817433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769ad4c-4198-4ca0-9e65-665ce43c5445 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:48.818175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769ad4c-4198-4ca0-9e65-665ce43c5445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:28:48.818481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769ad4c-4198-4ca0-9e65-665ce43c5445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:48.820117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769ad4c-4198-4ca0-9e65-665ce43c5445 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:48.833110 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1211/2398] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:28:48.837988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2932c-bee7-48e0-bdbc-f73ee684cc3b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:48.847672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2932c-bee7-48e0-bdbc-f73ee684cc3b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:48.853768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a31bc-b41e-40e4-9b15-262ac914f12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:48.854422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a31bc-b41e-40e4-9b15-262ac914f12a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:48.854689 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a31bc-b41e-40e4-9b15-262ac914f12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:48.854965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a31bc-b41e-40e4-9b15-262ac914f12a admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:48.855672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a31bc-b41e-40e4-9b15-262ac914f12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:48.857660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a31bc-b41e-40e4-9b15-262ac914f12a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:48.884617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1188/2399] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:28:48 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:48.889063 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769ad4c-4198-4ca0-9e65-665ce43c5445 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:48.902836 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769ad4c-4198-4ca0-9e65-665ce43c5445 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:48.962880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee236f9-57d9-46fd-9d9c-eb78a4ad1ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:48.963555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee236f9-57d9-46fd-9d9c-eb78a4ad1ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:48.963833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee236f9-57d9-46fd-9d9c-eb78a4ad1ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:48.964106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee236f9-57d9-46fd-9d9c-eb78a4ad1ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:48.964820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee236f9-57d9-46fd-9d9c-eb78a4ad1ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:48.966788 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee236f9-57d9-46fd-9d9c-eb78a4ad1ca3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:48.994208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1212/2400] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:28:48 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:48.996658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a31bc-b41e-40e4-9b15-262ac914f12a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:49.011729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a31bc-b41e-40e4-9b15-262ac914f12a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:49.021917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f14e90-03b0-40aa-bc92-3bcea0d1adc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:49.022285 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f14e90-03b0-40aa-bc92-3bcea0d1adc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.022562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f14e90-03b0-40aa-bc92-3bcea0d1adc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.022830 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f14e90-03b0-40aa-bc92-3bcea0d1adc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.023649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f14e90-03b0-40aa-bc92-3bcea0d1adc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:49.025513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f14e90-03b0-40aa-bc92-3bcea0d1adc8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:49.038425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1189/2401] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:28:49.043206 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee236f9-57d9-46fd-9d9c-eb78a4ad1ca3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:49.054485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee236f9-57d9-46fd-9d9c-eb78a4ad1ca3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:49.059884 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa622a-9a12-4ca0-a60b-fb493dde7d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:49.060663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa622a-9a12-4ca0-a60b-fb493dde7d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.060939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa622a-9a12-4ca0-a60b-fb493dde7d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.061436 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa622a-9a12-4ca0-a60b-fb493dde7d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.061979 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa622a-9a12-4ca0-a60b-fb493dde7d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:49.063617 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa622a-9a12-4ca0-a60b-fb493dde7d1a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:49.075473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1213/2402] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:28:49.081317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f14e90-03b0-40aa-bc92-3bcea0d1adc8 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:49.091759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f14e90-03b0-40aa-bc92-3bcea0d1adc8 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:49.096701 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54d47b-b22d-471b-8edb-bbe76a81f0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:49.097638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54d47b-b22d-471b-8edb-bbe76a81f0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.098056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54d47b-b22d-471b-8edb-bbe76a81f0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.098583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54d47b-b22d-471b-8edb-bbe76a81f0e6 admin admin] PATH_INFO: `/v3/projects/fd7b6fbd8e8446fd80926e1a9e3a0358/users/d71afa0e345641d98ecaff1953236f12/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.126555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54d47b-b22d-471b-8edb-bbe76a81f0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7b6fbd8e8446fd80926e1a9e3a0358, user_id=d71afa0e345641d98ecaff1953236f12, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:49.129634 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54d47b-b22d-471b-8edb-bbe76a81f0e6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:49.151293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1190/2403] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:28:49 2022] PUT /identity/v3/projects/fd7b6fbd8e8446fd80926e1a9e3a0358/users/d71afa0e345641d98ecaff1953236f12/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:49.162855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad9148-63b9-44ba-ad76-7bb21c45e37f None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.163240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad9148-63b9-44ba-ad76-7bb21c45e37f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.163591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad9148-63b9-44ba-ad76-7bb21c45e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.192674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9dad9148-63b9-44ba-ad76-7bb21c45e37f None None] MFA Rules not processed for user `d71afa0e345641d98ecaff1953236f12`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:49.193946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9dad9148-63b9-44ba-ad76-7bb21c45e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:49.267010 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1214/2404] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:49.272093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54d47b-b22d-471b-8edb-bbe76a81f0e6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:49.343030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54d47b-b22d-471b-8edb-bbe76a81f0e6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:49.348723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910fdb-c714-4302-b292-d956f7dceac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:49.349435 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910fdb-c714-4302-b292-d956f7dceac6 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.349710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910fdb-c714-4302-b292-d956f7dceac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.349973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910fdb-c714-4302-b292-d956f7dceac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.350678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910fdb-c714-4302-b292-d956f7dceac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:49.352638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910fdb-c714-4302-b292-d956f7dceac6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:49.385703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1191/2405] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:28:49 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:49.389741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad9148-63b9-44ba-ad76-7bb21c45e37f None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:49.403993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad9148-63b9-44ba-ad76-7bb21c45e37f None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:49.503996 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5ec34-03c5-46fa-88a8-95e33be5ae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:49.505055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ec34-03c5-46fa-88a8-95e33be5ae76 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.505544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ec34-03c5-46fa-88a8-95e33be5ae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.506003 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ec34-03c5-46fa-88a8-95e33be5ae76 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.507155 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5ec34-03c5-46fa-88a8-95e33be5ae76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:49.512883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5ec34-03c5-46fa-88a8-95e33be5ae76 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:49.541356 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1215/2406] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:28:49 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:49.548662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910fdb-c714-4302-b292-d956f7dceac6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:49.559922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910fdb-c714-4302-b292-d956f7dceac6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:49.564841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b909c-e43a-4865-906f-f6d5c9b026ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:49.565637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b909c-e43a-4865-906f-f6d5c9b026ba admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.566396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b909c-e43a-4865-906f-f6d5c9b026ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.566396 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b909c-e43a-4865-906f-f6d5c9b026ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.567270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b909c-e43a-4865-906f-f6d5c9b026ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:49.568936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b909c-e43a-4865-906f-f6d5c9b026ba admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:49.582033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1192/2407] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:28:49.587104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5ec34-03c5-46fa-88a8-95e33be5ae76 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:49.599339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5ec34-03c5-46fa-88a8-95e33be5ae76 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:49.602776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094e0c4-bb3e-4588-8ab4-c1535bc65646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:49.603857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094e0c4-bb3e-4588-8ab4-c1535bc65646 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.604132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094e0c4-bb3e-4588-8ab4-c1535bc65646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.604399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094e0c4-bb3e-4588-8ab4-c1535bc65646 admin admin] PATH_INFO: `/v3/projects/98c4a596158a4000b9ce49b0feb991a8/users/ddc0874ea8114ba2a5ff88f723438ec1/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.623203 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094e0c4-bb3e-4588-8ab4-c1535bc65646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c4a596158a4000b9ce49b0feb991a8, user_id=ddc0874ea8114ba2a5ff88f723438ec1, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:49.626805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094e0c4-bb3e-4588-8ab4-c1535bc65646 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:49.644945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1216/2408] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:28:49 2022] PUT /identity/v3/projects/98c4a596158a4000b9ce49b0feb991a8/users/ddc0874ea8114ba2a5ff88f723438ec1/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:49.649320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b909c-e43a-4865-906f-f6d5c9b026ba admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:49.661644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b909c-e43a-4865-906f-f6d5c9b026ba admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:49.748593 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663c4e7-dc72-4fdf-875f-8e8ae01d8068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:49.749298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c4e7-dc72-4fdf-875f-8e8ae01d8068 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.749581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c4e7-dc72-4fdf-875f-8e8ae01d8068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.749854 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c4e7-dc72-4fdf-875f-8e8ae01d8068 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.750602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663c4e7-dc72-4fdf-875f-8e8ae01d8068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:49.752335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663c4e7-dc72-4fdf-875f-8e8ae01d8068 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:49.769672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1193/2409] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:28:49.774011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094e0c4-bb3e-4588-8ab4-c1535bc65646 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:49.786309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094e0c4-bb3e-4588-8ab4-c1535bc65646 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:49.791620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79a245-8168-4edc-9a51-c2677b68ddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:49.792602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a245-8168-4edc-9a51-c2677b68ddea admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.792945 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a245-8168-4edc-9a51-c2677b68ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.793324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a245-8168-4edc-9a51-c2677b68ddea admin admin] PATH_INFO: `/v3/projects/98c4a596158a4000b9ce49b0feb991a8/users/ddc0874ea8114ba2a5ff88f723438ec1/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.795637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79a245-8168-4edc-9a51-c2677b68ddea admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c4a596158a4000b9ce49b0feb991a8, user_id=ddc0874ea8114ba2a5ff88f723438ec1, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:49.799221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79a245-8168-4edc-9a51-c2677b68ddea admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:49.815518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1217/2410] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:28:49 2022] PUT /identity/v3/projects/98c4a596158a4000b9ce49b0feb991a8/users/ddc0874ea8114ba2a5ff88f723438ec1/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:28:49.827032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d040-b958-43ca-bb75-3941a129bad9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:49.827379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d040-b958-43ca-bb75-3941a129bad9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:49.827653 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d040-b958-43ca-bb75-3941a129bad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:49.871537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d745d040-b958-43ca-bb75-3941a129bad9 None None] MFA Rules not processed for user `ddc0874ea8114ba2a5ff88f723438ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:49.873992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d745d040-b958-43ca-bb75-3941a129bad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:49.987652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1194/2411] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:28:50.002678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79a245-8168-4edc-9a51-c2677b68ddea admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:50.005257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-2b79a245-8168-4edc-9a51-c2677b68ddea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:50.105036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79a245-8168-4edc-9a51-c2677b68ddea admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:50.108623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef2321-5758-44bf-bfad-6255fc7fc7ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:50.109287 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef2321-5758-44bf-bfad-6255fc7fc7ec service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:50.109564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef2321-5758-44bf-bfad-6255fc7fc7ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:50.109831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef2321-5758-44bf-bfad-6255fc7fc7ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:50.118782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef2321-5758-44bf-bfad-6255fc7fc7ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:50.120214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef2321-5758-44bf-bfad-6255fc7fc7ec service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:50.129531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1218/2412] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:28:50.507173 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d040-b958-43ca-bb75-3941a129bad9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:50.574472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d040-b958-43ca-bb75-3941a129bad9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:50.581375 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:50.582025 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:50.582297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:50.582565 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] PATH_INFO: `/v3/users/d71afa0e345641d98ecaff1953236f12` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:50.584290 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d71afa0e345641d98ecaff1953236f12)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:50.586291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:50.633641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd71afa0e345641d98ecaff1953236f12'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:50.640356 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd71afa0e345641d98ecaff1953236f12'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:50.652117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd71afa0e345641d98ecaff1953236f12'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:50.652858 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd71afa0e345641d98ecaff1953236f12'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:50.661390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd71afa0e345641d98ecaff1953236f12'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:50.667516 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1195/2413] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:28:50 2022] DELETE /identity/v3/users/d71afa0e345641d98ecaff1953236f12 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:50.672174 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef6072-c43f-4234-b681-f9f6fb75f685 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:50.672556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef6072-c43f-4234-b681-f9f6fb75f685 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:50.672899 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef6072-c43f-4234-b681-f9f6fb75f685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:50.689933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-2eef6072-c43f-4234-b681-f9f6fb75f685 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:50.691502 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-2eef6072-c43f-4234-b681-f9f6fb75f685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:50.763467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1219/2414] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:50.774403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:50.775966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:50.834252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef851e39-585a-4d48-b94d-04661d8ad7b0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:50.838822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e56d28-bb8e-47c2-a4fc-42b2250a01a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:50.839013 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56d28-bb8e-47c2-a4fc-42b2250a01a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:50.839275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56d28-bb8e-47c2-a4fc-42b2250a01a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:50.839529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56d28-bb8e-47c2-a4fc-42b2250a01a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:50.849254 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e56d28-bb8e-47c2-a4fc-42b2250a01a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:50.851282 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e56d28-bb8e-47c2-a4fc-42b2250a01a0 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:50.863430 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1196/2415] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:28:51.143886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef6072-c43f-4234-b681-f9f6fb75f685 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:51.145981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-2eef6072-c43f-4234-b681-f9f6fb75f685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:51.156303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e56d28-bb8e-47c2-a4fc-42b2250a01a0 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:51.164011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef6072-c43f-4234-b681-f9f6fb75f685 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:51.166182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e56d28-bb8e-47c2-a4fc-42b2250a01a0 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:51.169921 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:51.171175 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:51.171620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5896437-5d04-4670-9e17-00fd89c4fda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:51.171850 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:51.172311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] PATH_INFO: `/v3/projects/fd7b6fbd8e8446fd80926e1a9e3a0358` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:51.173910 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5896437-5d04-4670-9e17-00fd89c4fda0 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:51.174203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5896437-5d04-4670-9e17-00fd89c4fda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:51.174492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5896437-5d04-4670-9e17-00fd89c4fda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:51.175051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7b6fbd8e8446fd80926e1a9e3a0358)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:51.177643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e5896437-5d04-4670-9e17-00fd89c4fda0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:51.178724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:51.228291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7b6fbd8e8446fd80926e1a9e3a0358', 'request_id': 'req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:51.235034 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7b6fbd8e8446fd80926e1a9e3a0358', 'request_id': 'req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:51.240416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7b6fbd8e8446fd80926e1a9e3a0358', 'request_id': 'req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:51.250492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5896437-5d04-4670-9e17-00fd89c4fda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:51.252202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5896437-5d04-4670-9e17-00fd89c4fda0 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:51.254160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] The token cache is being invalidate because project fd7b6fbd8e8446fd80926e1a9e3a0358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:28:51.254449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:51.256131 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:51.257645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1220/2416] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:28:51 2022] DELETE /identity/v3/projects/fd7b6fbd8e8446fd80926e1a9e3a0358 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:51.261302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:51.262679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:51.264037 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1197/2417] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:28:51.326988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ba4c-c389-4dfc-9545-1f7bb0c89028 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:51.334560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:51.335738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:51.336249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:51.336705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] PATH_INFO: `/v3/users/ddc0874ea8114ba2a5ff88f723438ec1` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:51.338028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc0874ea8114ba2a5ff88f723438ec1)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:51.340038 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:51.392816 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc0874ea8114ba2a5ff88f723438ec1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:51.400037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc0874ea8114ba2a5ff88f723438ec1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:51.401793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc0874ea8114ba2a5ff88f723438ec1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:51.417991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc0874ea8114ba2a5ff88f723438ec1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:51.452542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5aeca486-08fb-4da2-9f9a-197ea53dd4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc0874ea8114ba2a5ff88f723438ec1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:51.464344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1221/2418] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:28:51 2022] DELETE /identity/v3/users/ddc0874ea8114ba2a5ff88f723438ec1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:28:52.051174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5896437-5d04-4670-9e17-00fd89c4fda0 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:52.077692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5896437-5d04-4670-9e17-00fd89c4fda0 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:52.192615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:52.194381 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:52.194875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:52.195442 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] PATH_INFO: `/v3/projects/98c4a596158a4000b9ce49b0feb991a8` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:52.197300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c4a596158a4000b9ce49b0feb991a8)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:52.200245 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:52.280039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c4a596158a4000b9ce49b0feb991a8', 'request_id': 'req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:52.290610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c4a596158a4000b9ce49b0feb991a8', 'request_id': 'req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:52.299859 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c4a596158a4000b9ce49b0feb991a8', 'request_id': 'req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:52.317009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] The token cache is being invalidate because project 98c4a596158a4000b9ce49b0feb991a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:28:52.317862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:52.318707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-bbb8d03c-59cc-48c4-9d1c-3ba5c5ca5bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:52.323788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1198/2419] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:28:52 2022] DELETE /identity/v3/projects/98c4a596158a4000b9ce49b0feb991a8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:52.330582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc14af-5df5-4313-8ed2-a0fabd7457be None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:52.331204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc14af-5df5-4313-8ed2-a0fabd7457be None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:52.331204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc14af-5df5-4313-8ed2-a0fabd7457be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:52.353348 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-41dc14af-5df5-4313-8ed2-a0fabd7457be None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:52.354909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-41dc14af-5df5-4313-8ed2-a0fabd7457be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:52.446979 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1222/2420] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:52.455740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e6d0-1b68-4c38-bc16-f189a4dc558c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:52.456137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e6d0-1b68-4c38-bc16-f189a4dc558c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:52.456311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9e6d0-1b68-4c38-bc16-f189a4dc558c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:52.487219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3aa9e6d0-1b68-4c38-bc16-f189a4dc558c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:52.489943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3aa9e6d0-1b68-4c38-bc16-f189a4dc558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:52.506672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1199/2421] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:52.513456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc14af-5df5-4313-8ed2-a0fabd7457be None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:52.526796 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc14af-5df5-4313-8ed2-a0fabd7457be None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:52.532003 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f50e7-21d4-46b2-8bf6-23f24cbace61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:52.532997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f50e7-21d4-46b2-8bf6-23f24cbace61 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:52.533817 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f50e7-21d4-46b2-8bf6-23f24cbace61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:52.534294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f50e7-21d4-46b2-8bf6-23f24cbace61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:52.535266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f50e7-21d4-46b2-8bf6-23f24cbace61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:28:52.535776 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f50e7-21d4-46b2-8bf6-23f24cbace61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:52.537655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f50e7-21d4-46b2-8bf6-23f24cbace61 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:52.557041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e6d0-1b68-4c38-bc16-f189a4dc558c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:52.562734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1223/2422] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:28:52.566887 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9e6d0-1b68-4c38-bc16-f189a4dc558c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:52.573456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027a432-9fc3-455a-8577-90c65a2d036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:52.574429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027a432-9fc3-455a-8577-90c65a2d036d admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:52.574868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027a432-9fc3-455a-8577-90c65a2d036d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:52.575285 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027a432-9fc3-455a-8577-90c65a2d036d admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:52.576320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027a432-9fc3-455a-8577-90c65a2d036d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:52.578491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027a432-9fc3-455a-8577-90c65a2d036d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:52.640350 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1200/2423] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:28:52 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:52.641845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f50e7-21d4-46b2-8bf6-23f24cbace61 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:52.652559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f50e7-21d4-46b2-8bf6-23f24cbace61 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:52.773041 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983e546-958a-41f5-84a2-5fcd8ecbf45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:52.774168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983e546-958a-41f5-84a2-5fcd8ecbf45e admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:52.774638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983e546-958a-41f5-84a2-5fcd8ecbf45e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:52.775092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983e546-958a-41f5-84a2-5fcd8ecbf45e admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:52.776009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983e546-958a-41f5-84a2-5fcd8ecbf45e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:52.778115 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983e546-958a-41f5-84a2-5fcd8ecbf45e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:52.808893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1224/2424] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:28:52 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:52.812821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027a432-9fc3-455a-8577-90c65a2d036d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:52.834933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027a432-9fc3-455a-8577-90c65a2d036d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:52.843508 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63339c-760d-4dde-9a49-7c00b7e60ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:52.844611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63339c-760d-4dde-9a49-7c00b7e60ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:52.845056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63339c-760d-4dde-9a49-7c00b7e60ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:52.845556 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63339c-760d-4dde-9a49-7c00b7e60ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:52.846844 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63339c-760d-4dde-9a49-7c00b7e60ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:52.849298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63339c-760d-4dde-9a49-7c00b7e60ed4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:52.872131 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1201/2425] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:28:52.873460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983e546-958a-41f5-84a2-5fcd8ecbf45e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:52.885574 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983e546-958a-41f5-84a2-5fcd8ecbf45e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:52.895679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57664f19-34a2-4713-abca-c32d82cb56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:52.896380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57664f19-34a2-4713-abca-c32d82cb56b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:52.896664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57664f19-34a2-4713-abca-c32d82cb56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:52.896941 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57664f19-34a2-4713-abca-c32d82cb56b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:52.897734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57664f19-34a2-4713-abca-c32d82cb56b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:52.901044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57664f19-34a2-4713-abca-c32d82cb56b7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:52.920106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1225/2426] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:28:52.921787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63339c-760d-4dde-9a49-7c00b7e60ed4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:52.934808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63339c-760d-4dde-9a49-7c00b7e60ed4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:52.941640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75131-f2c8-4acd-8207-797d9eacbfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:52.942759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75131-f2c8-4acd-8207-797d9eacbfba admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:52.943040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75131-f2c8-4acd-8207-797d9eacbfba admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:52.943315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c75131-f2c8-4acd-8207-797d9eacbfba admin admin] PATH_INFO: `/v3/projects/11e882ffa7f845bc856d17a8659232bb/users/52c3a022f942414daeb5b362904686cc/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:52.962492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c75131-f2c8-4acd-8207-797d9eacbfba admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e882ffa7f845bc856d17a8659232bb, user_id=52c3a022f942414daeb5b362904686cc, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:52.965768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c75131-f2c8-4acd-8207-797d9eacbfba admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:52.982657 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1202/2427] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:28:52 2022] PUT /identity/v3/projects/11e882ffa7f845bc856d17a8659232bb/users/52c3a022f942414daeb5b362904686cc/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:52.994170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8c73-4292-474b-9983-47f5a0d7a709 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:52.994448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8c73-4292-474b-9983-47f5a0d7a709 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:52.994677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8c73-4292-474b-9983-47f5a0d7a709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:53.041187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e49c8c73-4292-474b-9983-47f5a0d7a709 None None] MFA Rules not processed for user `52c3a022f942414daeb5b362904686cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:53.042612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e49c8c73-4292-474b-9983-47f5a0d7a709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:53.137624 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1226/2428] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:53.142619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75131-f2c8-4acd-8207-797d9eacbfba admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:53.224490 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c75131-f2c8-4acd-8207-797d9eacbfba admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:53.230122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad72979-51af-4a74-8fd9-0c7f702e4f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:53.230836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72979-51af-4a74-8fd9-0c7f702e4f70 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:53.231105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72979-51af-4a74-8fd9-0c7f702e4f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:53.231489 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72979-51af-4a74-8fd9-0c7f702e4f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:53.232498 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad72979-51af-4a74-8fd9-0c7f702e4f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:53.234643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad72979-51af-4a74-8fd9-0c7f702e4f70 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:53.269679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1203/2429] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:28:53 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:53.274018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c8c73-4292-474b-9983-47f5a0d7a709 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:53.288544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c8c73-4292-474b-9983-47f5a0d7a709 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:53.377450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cf57d-294c-4bf8-afc5-240e80e2f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:53.378163 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cf57d-294c-4bf8-afc5-240e80e2f232 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:53.378419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cf57d-294c-4bf8-afc5-240e80e2f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:53.378689 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cf57d-294c-4bf8-afc5-240e80e2f232 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:53.379788 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cf57d-294c-4bf8-afc5-240e80e2f232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:53.381958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cf57d-294c-4bf8-afc5-240e80e2f232 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:53.416784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1227/2430] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:28:53 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:53.421133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad72979-51af-4a74-8fd9-0c7f702e4f70 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:53.441092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad72979-51af-4a74-8fd9-0c7f702e4f70 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:53.455625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97bde-fedc-40fa-ae41-b6d0447096b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:53.456322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97bde-fedc-40fa-ae41-b6d0447096b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:53.456599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97bde-fedc-40fa-ae41-b6d0447096b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:53.456873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97bde-fedc-40fa-ae41-b6d0447096b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:53.457660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f97bde-fedc-40fa-ae41-b6d0447096b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:53.459947 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f97bde-fedc-40fa-ae41-b6d0447096b6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:53.480948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1204/2431] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:28:53.485609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cf57d-294c-4bf8-afc5-240e80e2f232 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:53.502436 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cf57d-294c-4bf8-afc5-240e80e2f232 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:53.507245 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d568d9-09ba-4c47-bae9-bdfef6ae39ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:53.507961 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d568d9-09ba-4c47-bae9-bdfef6ae39ca admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:53.508857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d568d9-09ba-4c47-bae9-bdfef6ae39ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:53.508857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d568d9-09ba-4c47-bae9-bdfef6ae39ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:53.509424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d568d9-09ba-4c47-bae9-bdfef6ae39ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:53.512077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d568d9-09ba-4c47-bae9-bdfef6ae39ca admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:53.528519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1228/2432] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:28:53.532665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97bde-fedc-40fa-ae41-b6d0447096b6 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:53.553317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97bde-fedc-40fa-ae41-b6d0447096b6 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:53.561841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5137840-e0ed-4a30-8064-a6c40e201fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:53.562882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5137840-e0ed-4a30-8064-a6c40e201fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:53.563254 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5137840-e0ed-4a30-8064-a6c40e201fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:53.563742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5137840-e0ed-4a30-8064-a6c40e201fb0 admin admin] PATH_INFO: `/v3/projects/dd1ac5c828494d40bda552122cec54c9/users/424247dba118472f9b8685d47b51a48a/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:53.592030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5137840-e0ed-4a30-8064-a6c40e201fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1ac5c828494d40bda552122cec54c9, user_id=424247dba118472f9b8685d47b51a48a, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:53.597679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5137840-e0ed-4a30-8064-a6c40e201fb0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:53.616641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1205/2433] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:28:53 2022] PUT /identity/v3/projects/dd1ac5c828494d40bda552122cec54c9/users/424247dba118472f9b8685d47b51a48a/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:53.627318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c833c7-d324-4d11-9a18-568aa1240cb5 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:53.627798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c833c7-d324-4d11-9a18-568aa1240cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:53.628527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c833c7-d324-4d11-9a18-568aa1240cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:53.658695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-35c833c7-d324-4d11-9a18-568aa1240cb5 None None] MFA Rules not processed for user `424247dba118472f9b8685d47b51a48a`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:53.659987 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-35c833c7-d324-4d11-9a18-568aa1240cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:53.748261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1229/2434] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:53.752810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5137840-e0ed-4a30-8064-a6c40e201fb0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:53.829790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5137840-e0ed-4a30-8064-a6c40e201fb0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:53.847140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b4ef1-f392-4232-85ea-50ec72d9f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:53.847140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4ef1-f392-4232-85ea-50ec72d9f2aa admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:53.847140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4ef1-f392-4232-85ea-50ec72d9f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:53.847140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4ef1-f392-4232-85ea-50ec72d9f2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:53.847538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b4ef1-f392-4232-85ea-50ec72d9f2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:53.847538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b4ef1-f392-4232-85ea-50ec72d9f2aa admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:53.890999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1206/2435] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:28:53 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:53.892542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c833c7-d324-4d11-9a18-568aa1240cb5 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:53.913598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c833c7-d324-4d11-9a18-568aa1240cb5 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:54.020376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8135e6-181f-4c7b-9b5d-62dd9f8b36b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:54.021715 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8135e6-181f-4c7b-9b5d-62dd9f8b36b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:54.022014 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8135e6-181f-4c7b-9b5d-62dd9f8b36b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:54.022298 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8135e6-181f-4c7b-9b5d-62dd9f8b36b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:54.023018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8135e6-181f-4c7b-9b5d-62dd9f8b36b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:54.026009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8135e6-181f-4c7b-9b5d-62dd9f8b36b7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:54.065643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1230/2436] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:28:53 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:28:54.069488 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b4ef1-f392-4232-85ea-50ec72d9f2aa admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:54.086224 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b4ef1-f392-4232-85ea-50ec72d9f2aa admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:54.093570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c36a43-7bdd-4447-925b-dbc9b3d4351a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:54.094636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36a43-7bdd-4447-925b-dbc9b3d4351a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:54.094636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36a43-7bdd-4447-925b-dbc9b3d4351a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:54.094857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36a43-7bdd-4447-925b-dbc9b3d4351a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:54.095526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c36a43-7bdd-4447-925b-dbc9b3d4351a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:54.097188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c36a43-7bdd-4447-925b-dbc9b3d4351a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:54.115732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8135e6-181f-4c7b-9b5d-62dd9f8b36b7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:54.117270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1207/2437] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:28:54.129312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8135e6-181f-4c7b-9b5d-62dd9f8b36b7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:54.142037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e000e1-14e4-4f5e-936c-b37163ee1da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:54.142964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e000e1-14e4-4f5e-936c-b37163ee1da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:54.143243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e000e1-14e4-4f5e-936c-b37163ee1da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:54.143518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e000e1-14e4-4f5e-936c-b37163ee1da6 admin admin] PATH_INFO: `/v3/projects/9ac16737c388476f9c7213f35974a5d5/users/c7aa4b9bd9094e86af6dfa72abaa82ac/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:54.171618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e000e1-14e4-4f5e-936c-b37163ee1da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac16737c388476f9c7213f35974a5d5, user_id=c7aa4b9bd9094e86af6dfa72abaa82ac, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:54.175626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e000e1-14e4-4f5e-936c-b37163ee1da6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:54.202765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1231/2438] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:28:54 2022] PUT /identity/v3/projects/9ac16737c388476f9c7213f35974a5d5/users/c7aa4b9bd9094e86af6dfa72abaa82ac/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:28:54.207071 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c36a43-7bdd-4447-925b-dbc9b3d4351a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:54.224227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c36a43-7bdd-4447-925b-dbc9b3d4351a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:54.310647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24b005-dfec-4800-8de1-0ad727b0cdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:54.311545 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b005-dfec-4800-8de1-0ad727b0cdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:54.311987 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b005-dfec-4800-8de1-0ad727b0cdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:54.312538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b005-dfec-4800-8de1-0ad727b0cdb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:54.313963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24b005-dfec-4800-8de1-0ad727b0cdb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:54.316709 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24b005-dfec-4800-8de1-0ad727b0cdb1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:54.336754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1208/2439] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:28:54.341683 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e000e1-14e4-4f5e-936c-b37163ee1da6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:54.355781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e000e1-14e4-4f5e-936c-b37163ee1da6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:54.373499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1594b2-75f9-458d-9f23-4c101aabc443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:54.374362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1594b2-75f9-458d-9f23-4c101aabc443 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:54.374642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1594b2-75f9-458d-9f23-4c101aabc443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:54.374916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1594b2-75f9-458d-9f23-4c101aabc443 admin admin] PATH_INFO: `/v3/projects/9ac16737c388476f9c7213f35974a5d5/users/c7aa4b9bd9094e86af6dfa72abaa82ac/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:54.380882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1594b2-75f9-458d-9f23-4c101aabc443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac16737c388476f9c7213f35974a5d5, user_id=c7aa4b9bd9094e86af6dfa72abaa82ac, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:54.383870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1594b2-75f9-458d-9f23-4c101aabc443 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:54.408536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1232/2440] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:28:54 2022] PUT /identity/v3/projects/9ac16737c388476f9c7213f35974a5d5/users/c7aa4b9bd9094e86af6dfa72abaa82ac/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:54.417117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f33f-8ac2-4c97-a47a-a52a636622b9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:54.417450 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f33f-8ac2-4c97-a47a-a52a636622b9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:54.417931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426f33f-8ac2-4c97-a47a-a52a636622b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:54.459466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7426f33f-8ac2-4c97-a47a-a52a636622b9 None None] MFA Rules not processed for user `c7aa4b9bd9094e86af6dfa72abaa82ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:54.463750 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7426f33f-8ac2-4c97-a47a-a52a636622b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:54.580349 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1594b2-75f9-458d-9f23-4c101aabc443 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:54.582640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-df1594b2-75f9-458d-9f23-4c101aabc443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:54.597756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1209/2441] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:54.610218 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426f33f-8ac2-4c97-a47a-a52a636622b9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:54.612734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7426f33f-8ac2-4c97-a47a-a52a636622b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:54.684818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1594b2-75f9-458d-9f23-4c101aabc443 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:54.690734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426f33f-8ac2-4c97-a47a-a52a636622b9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:54.692122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:54.693051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:54.693331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:54.693609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] PATH_INFO: `/v3/users/3bc86d41bb2d4509913630ca774b4082` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:54.695032 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc86d41bb2d4509913630ca774b4082)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:54.695246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16bcbb-5e60-4b6e-be20-b7cea67a79af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:54.695953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16bcbb-5e60-4b6e-be20-b7cea67a79af service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:54.696308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16bcbb-5e60-4b6e-be20-b7cea67a79af service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:54.696641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16bcbb-5e60-4b6e-be20-b7cea67a79af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:54.698034 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:54.706945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16bcbb-5e60-4b6e-be20-b7cea67a79af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:54.708501 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16bcbb-5e60-4b6e-be20-b7cea67a79af service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:54.723446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1210/2442] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:28:54.764432 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc86d41bb2d4509913630ca774b4082'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:54.771716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16bcbb-5e60-4b6e-be20-b7cea67a79af service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:54.773256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0b16bcbb-5e60-4b6e-be20-b7cea67a79af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:54.774544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc86d41bb2d4509913630ca774b4082'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:54.775537 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc86d41bb2d4509913630ca774b4082'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:54.786707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16bcbb-5e60-4b6e-be20-b7cea67a79af service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:54.790954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af1193-fd94-455c-9722-b99eff26af1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:54.792267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af1193-fd94-455c-9722-b99eff26af1c service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:54.792267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af1193-fd94-455c-9722-b99eff26af1c service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:54.792767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af1193-fd94-455c-9722-b99eff26af1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:54.795679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc86d41bb2d4509913630ca774b4082'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:54.814108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc86d41bb2d4509913630ca774b4082'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:54.822686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1233/2443] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:28:54 2022] DELETE /identity/v3/users/3bc86d41bb2d4509913630ca774b4082 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:54.883752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af1193-fd94-455c-9722-b99eff26af1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:54.885278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af1193-fd94-455c-9722-b99eff26af1c service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:54.895360 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1211/2444] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:28:55.245111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:55.247301 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:55.367109 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a72f-359b-4c3c-85ea-dd93e8cb5e36 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:55.372334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:55.373212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:55.373513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:55.373783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] PATH_INFO: `/v3/projects/c5a4cb240dac42849a9790a68eda072a` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:55.375657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a4cb240dac42849a9790a68eda072a)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:55.379633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:55.440619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a4cb240dac42849a9790a68eda072a', 'request_id': 'req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:55.450118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a4cb240dac42849a9790a68eda072a', 'request_id': 'req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:55.458868 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a4cb240dac42849a9790a68eda072a', 'request_id': 'req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:55.475273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] The token cache is being invalidate because project c5a4cb240dac42849a9790a68eda072a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:28:55.475600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:55.477937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c6b7699a-2fd2-4a90-a2e6-072cb342fa04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:55.479577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1234/2445] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:28:55 2022] DELETE /identity/v3/projects/c5a4cb240dac42849a9790a68eda072a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:55.485557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61388db-b8d3-4502-b071-72df285ad528 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:55.486142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61388db-b8d3-4502-b071-72df285ad528 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:55.486142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61388db-b8d3-4502-b071-72df285ad528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:55.504640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b61388db-b8d3-4502-b071-72df285ad528 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:55.505866 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b61388db-b8d3-4502-b071-72df285ad528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:55.570202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1212/2446] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:55.578872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03392-f9f1-4ba6-b52b-53b7069bb8a8 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:55.579287 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03392-f9f1-4ba6-b52b-53b7069bb8a8 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:55.579647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03392-f9f1-4ba6-b52b-53b7069bb8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:55.601526 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-73e03392-f9f1-4ba6-b52b-53b7069bb8a8 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:55.602746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-73e03392-f9f1-4ba6-b52b-53b7069bb8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:55.613294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1235/2447] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:55.619596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61388db-b8d3-4502-b071-72df285ad528 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:55.629624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61388db-b8d3-4502-b071-72df285ad528 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:55.634914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084588d9-4128-412f-b469-c00d5404d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:55.635588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084588d9-4128-412f-b469-c00d5404d9cf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:55.635863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084588d9-4128-412f-b469-c00d5404d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:55.636145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084588d9-4128-412f-b469-c00d5404d9cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:55.636885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084588d9-4128-412f-b469-c00d5404d9cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:28:55.637191 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084588d9-4128-412f-b469-c00d5404d9cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:55.638850 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084588d9-4128-412f-b469-c00d5404d9cf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:55.653865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1213/2448] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:28:55.658555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e03392-f9f1-4ba6-b52b-53b7069bb8a8 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:55.668399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e03392-f9f1-4ba6-b52b-53b7069bb8a8 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:55.674111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06c79f-9087-4d21-8457-d3888f53a293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:55.674809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c79f-9087-4d21-8457-d3888f53a293 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:55.675080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c79f-9087-4d21-8457-d3888f53a293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:55.675344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c79f-9087-4d21-8457-d3888f53a293 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:55.676059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06c79f-9087-4d21-8457-d3888f53a293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:55.678033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06c79f-9087-4d21-8457-d3888f53a293 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:55.707811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1236/2449] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:28:55 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:55.712286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084588d9-4128-412f-b469-c00d5404d9cf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:55.722787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084588d9-4128-412f-b469-c00d5404d9cf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:55.799501 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e4b16-c1c0-43d1-b962-0ae6b78ef143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:55.800649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e4b16-c1c0-43d1-b962-0ae6b78ef143 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:55.801289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e4b16-c1c0-43d1-b962-0ae6b78ef143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:55.801761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e4b16-c1c0-43d1-b962-0ae6b78ef143 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:55.802928 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e4b16-c1c0-43d1-b962-0ae6b78ef143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:55.806510 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e4b16-c1c0-43d1-b962-0ae6b78ef143 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:55.829459 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1214/2450] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:28:55 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:28:55.834773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06c79f-9087-4d21-8457-d3888f53a293 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:55.845770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06c79f-9087-4d21-8457-d3888f53a293 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:55.850819 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995a111-9818-450b-921a-130ac1115dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:55.851524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995a111-9818-450b-921a-130ac1115dec admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:55.851801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995a111-9818-450b-921a-130ac1115dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:55.852068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995a111-9818-450b-921a-130ac1115dec admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:55.852811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995a111-9818-450b-921a-130ac1115dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:55.854446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995a111-9818-450b-921a-130ac1115dec admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:55.865704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1237/2451] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:28:55.869977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e4b16-c1c0-43d1-b962-0ae6b78ef143 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:55.880257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e4b16-c1c0-43d1-b962-0ae6b78ef143 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:55.885270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf660-5f17-4783-acc3-5f766fedf239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:55.885995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf660-5f17-4783-acc3-5f766fedf239 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:55.886269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf660-5f17-4783-acc3-5f766fedf239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:55.886536 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf660-5f17-4783-acc3-5f766fedf239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:55.887278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdf660-5f17-4783-acc3-5f766fedf239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:55.888858 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fdf660-5f17-4783-acc3-5f766fedf239 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:55.900074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1215/2452] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:28:55.904849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995a111-9818-450b-921a-130ac1115dec admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:55.915320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995a111-9818-450b-921a-130ac1115dec admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:55.920408 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfc0bf-1ca0-4994-986f-fae600e4f989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:55.921333 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfc0bf-1ca0-4994-986f-fae600e4f989 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:55.921618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfc0bf-1ca0-4994-986f-fae600e4f989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:55.921890 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfc0bf-1ca0-4994-986f-fae600e4f989 admin admin] PATH_INFO: `/v3/projects/0639b703e727474d8b71d24f7709a813/users/f02cd9096152479da885ead20d3ec061/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:55.937967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfc0bf-1ca0-4994-986f-fae600e4f989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0639b703e727474d8b71d24f7709a813, user_id=f02cd9096152479da885ead20d3ec061, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:55.940645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfc0bf-1ca0-4994-986f-fae600e4f989 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:55.957287 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1238/2453] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:28:55 2022] PUT /identity/v3/projects/0639b703e727474d8b71d24f7709a813/users/f02cd9096152479da885ead20d3ec061/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:55.962787 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b762e-fbce-47ef-ac63-40ecc707dba8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:55.963225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b762e-fbce-47ef-ac63-40ecc707dba8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:55.963597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b762e-fbce-47ef-ac63-40ecc707dba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:55.983253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c00b762e-fbce-47ef-ac63-40ecc707dba8 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:55.984483 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c00b762e-fbce-47ef-ac63-40ecc707dba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:56.050907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1216/2454] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:56.062093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfc0bf-1ca0-4994-986f-fae600e4f989 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:56.063902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8edfc0bf-1ca0-4994-986f-fae600e4f989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:56.123751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfc0bf-1ca0-4994-986f-fae600e4f989 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:56.127414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4b848-98b4-406b-8759-77c4d6bf6400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:56.128059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4b848-98b4-406b-8759-77c4d6bf6400 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:56.128338 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4b848-98b4-406b-8759-77c4d6bf6400 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:56.128610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4b848-98b4-406b-8759-77c4d6bf6400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:56.137690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4b848-98b4-406b-8759-77c4d6bf6400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:56.139124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4b848-98b4-406b-8759-77c4d6bf6400 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:56.148446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1239/2455] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:28:56.594620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25faf7-94d8-469a-9f7c-c7988bec341b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:56.596026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25faf7-94d8-469a-9f7c-c7988bec341b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:56.596226 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25faf7-94d8-469a-9f7c-c7988bec341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:56.677842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-0d25faf7-94d8-469a-9f7c-c7988bec341b None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:56.679132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0d25faf7-94d8-469a-9f7c-c7988bec341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:56.801840 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1217/2456] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jan 28 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:56.819274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4b848-98b4-406b-8759-77c4d6bf6400 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:56.822243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-dfd4b848-98b4-406b-8759-77c4d6bf6400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:56.978234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4b848-98b4-406b-8759-77c4d6bf6400 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:56.984705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ad0fe-7277-4a39-a9c5-157cffaffc91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:56.985402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad0fe-7277-4a39-a9c5-157cffaffc91 service swift] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:56.985677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad0fe-7277-4a39-a9c5-157cffaffc91 service swift] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:56.986119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ad0fe-7277-4a39-a9c5-157cffaffc91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:56.995427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ad0fe-7277-4a39-a9c5-157cffaffc91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:56.997024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ad0fe-7277-4a39-a9c5-157cffaffc91 service swift] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:57.006276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1240/2457] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:28:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:58.096266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25faf7-94d8-469a-9f7c-c7988bec341b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:58.098311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0d25faf7-94d8-469a-9f7c-c7988bec341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:58.114169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25faf7-94d8-469a-9f7c-c7988bec341b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:58.119366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:58.120041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:58.120313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:58.120579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] PATH_INFO: `/v3/users/52c3a022f942414daeb5b362904686cc` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:58.122122 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c3a022f942414daeb5b362904686cc)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:58.124145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:58.179191 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c3a022f942414daeb5b362904686cc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.185968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c3a022f942414daeb5b362904686cc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.197510 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c3a022f942414daeb5b362904686cc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.198232 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c3a022f942414daeb5b362904686cc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.206729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c3a022f942414daeb5b362904686cc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.213041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1218/2458] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:28:58 2022] DELETE /identity/v3/users/52c3a022f942414daeb5b362904686cc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:58.217783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9369-fd38-4227-93fb-1d0ad563ad28 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:58.218291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9369-fd38-4227-93fb-1d0ad563ad28 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:58.218387 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9369-fd38-4227-93fb-1d0ad563ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:58.237783 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-235b9369-fd38-4227-93fb-1d0ad563ad28 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:28:58.238925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-235b9369-fd38-4227-93fb-1d0ad563ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:58.300471 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1241/2459] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:28:58.311277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:58.312916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:58.373851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aca0b8-8736-4102-ba68-80eaac4e688e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:58.377691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055f0b7-b3a7-4eea-9f7b-d5d79c567fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:58.378333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055f0b7-b3a7-4eea-9f7b-d5d79c567fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:58.378608 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055f0b7-b3a7-4eea-9f7b-d5d79c567fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:58.378871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055f0b7-b3a7-4eea-9f7b-d5d79c567fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:58.388115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055f0b7-b3a7-4eea-9f7b-d5d79c567fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:58.389591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055f0b7-b3a7-4eea-9f7b-d5d79c567fb9 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:58.399025 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1219/2460] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:28:58.683463 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b9369-fd38-4227-93fb-1d0ad563ad28 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:58.684925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-235b9369-fd38-4227-93fb-1d0ad563ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:58.714253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b9369-fd38-4227-93fb-1d0ad563ad28 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:58.719291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:58.721014 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:58.721755 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:58.722457 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] PATH_INFO: `/v3/projects/11e882ffa7f845bc856d17a8659232bb` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:58.724026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e882ffa7f845bc856d17a8659232bb)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:58.725994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:58.781712 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e882ffa7f845bc856d17a8659232bb', 'request_id': 'req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.788216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e882ffa7f845bc856d17a8659232bb', 'request_id': 'req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.795188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e882ffa7f845bc856d17a8659232bb', 'request_id': 'req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.808625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] The token cache is being invalidate because project 11e882ffa7f845bc856d17a8659232bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:28:58.809057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.809719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.811259 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1242/2461] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:28:58 2022] DELETE /identity/v3/projects/11e882ffa7f845bc856d17a8659232bb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:28:58.815346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055f0b7-b3a7-4eea-9f7b-d5d79c567fb9 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:58.830770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055f0b7-b3a7-4eea-9f7b-d5d79c567fb9 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:58.899172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:58.900367 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:58.900723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:58.901077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] PATH_INFO: `/v3/users/424247dba118472f9b8685d47b51a48a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:58.902489 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=424247dba118472f9b8685d47b51a48a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:58.904918 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:58.952821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '424247dba118472f9b8685d47b51a48a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.960539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '424247dba118472f9b8685d47b51a48a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.973910 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '424247dba118472f9b8685d47b51a48a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.974740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '424247dba118472f9b8685d47b51a48a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.984418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '424247dba118472f9b8685d47b51a48a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:58.992578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1220/2462] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:28:58 2022] DELETE /identity/v3/users/424247dba118472f9b8685d47b51a48a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:28:59.747981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:28:59.750370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:28:59.770144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd9680-0798-4ee0-aa78-6e74240b4bbe admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:28:59.879174 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:28:59.880315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:28:59.880650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:28:59.881006 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] PATH_INFO: `/v3/projects/dd1ac5c828494d40bda552122cec54c9` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:28:59.883973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1ac5c828494d40bda552122cec54c9)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:28:59.886185 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:28:59.952478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1ac5c828494d40bda552122cec54c9', 'request_id': 'req-9faa73be-6ab2-479b-bc0f-b117941c5c0c'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:59.961685 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1ac5c828494d40bda552122cec54c9', 'request_id': 'req-9faa73be-6ab2-479b-bc0f-b117941c5c0c'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:59.969906 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1ac5c828494d40bda552122cec54c9', 'request_id': 'req-9faa73be-6ab2-479b-bc0f-b117941c5c0c'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:59.994688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] The token cache is being invalidate because project dd1ac5c828494d40bda552122cec54c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:28:59.995661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:59.996354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-9faa73be-6ab2-479b-bc0f-b117941c5c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:28:59.998477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1243/2463] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:28:59 2022] DELETE /identity/v3/projects/dd1ac5c828494d40bda552122cec54c9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:00.002810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:00.004326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:00.020597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09481dfb-39f2-445f-9e33-72884b91f050 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:00.130331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:00.131213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:00.131507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:00.131998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] PATH_INFO: `/v3/users/c7aa4b9bd9094e86af6dfa72abaa82ac` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:00.133729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7aa4b9bd9094e86af6dfa72abaa82ac)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:00.135819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:00.207800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7aa4b9bd9094e86af6dfa72abaa82ac'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:00.217472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7aa4b9bd9094e86af6dfa72abaa82ac'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:00.232528 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7aa4b9bd9094e86af6dfa72abaa82ac'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:00.233750 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7aa4b9bd9094e86af6dfa72abaa82ac'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:00.243390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7aa4b9bd9094e86af6dfa72abaa82ac'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:00.251806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1221/2464] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:29:00 2022] DELETE /identity/v3/users/c7aa4b9bd9094e86af6dfa72abaa82ac => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:00.728441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f4a52-fbc6-4149-9436-364c73f22348 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:00.728441 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f4a52-fbc6-4149-9436-364c73f22348 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:00.728942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f4a52-fbc6-4149-9436-364c73f22348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:00.744626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:00.747086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:00.776180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-901f4a52-fbc6-4149-9436-364c73f22348 None None] MFA Rules not processed for user `f02cd9096152479da885ead20d3ec061`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:00.777514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-901f4a52-fbc6-4149-9436-364c73f22348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:00.834238 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f01d67-a0c2-4467-ba3e-b27fcc5c075d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:00.839185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:00.840053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:00.840331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:00.840599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] PATH_INFO: `/v3/projects/9ac16737c388476f9c7213f35974a5d5` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:00.841912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac16737c388476f9c7213f35974a5d5)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:00.843818 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:00.854182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1244/2465] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:00.866443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f4a52-fbc6-4149-9436-364c73f22348 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:00.869185 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-901f4a52-fbc6-4149-9436-364c73f22348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:00.911535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac16737c388476f9c7213f35974a5d5', 'request_id': 'req-1e338d23-3094-4885-8ce1-871a7abef1d8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:00.922661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac16737c388476f9c7213f35974a5d5', 'request_id': 'req-1e338d23-3094-4885-8ce1-871a7abef1d8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:00.929900 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac16737c388476f9c7213f35974a5d5', 'request_id': 'req-1e338d23-3094-4885-8ce1-871a7abef1d8'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:00.946319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] The token cache is being invalidate because project 9ac16737c388476f9c7213f35974a5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:29:00.946712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:00.947450 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-1e338d23-3094-4885-8ce1-871a7abef1d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:00.949081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1222/2466] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:29:00 2022] DELETE /identity/v3/projects/9ac16737c388476f9c7213f35974a5d5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:00.956318 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a637b75-7061-4deb-bea2-fc765062701d None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:00.956573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a637b75-7061-4deb-bea2-fc765062701d None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:00.956852 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a637b75-7061-4deb-bea2-fc765062701d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:00.975575 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f4a52-fbc6-4149-9436-364c73f22348 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:00.978293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2a637b75-7061-4deb-bea2-fc765062701d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:00.979777 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2a637b75-7061-4deb-bea2-fc765062701d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:01.042507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbd0d1-2837-4df6-9ed9-f6619c8ca3b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:01.043252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbd0d1-2837-4df6-9ed9-f6619c8ca3b0 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.043598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbd0d1-2837-4df6-9ed9-f6619c8ca3b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.043936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbd0d1-2837-4df6-9ed9-f6619c8ca3b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.045798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b6cbd0d1-2837-4df6-9ed9-f6619c8ca3b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:01.046297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1223/2467] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:29:01.054784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396566-ab0b-47ae-a254-08ea1c6872e7 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.055151 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396566-ab0b-47ae-a254-08ea1c6872e7 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.055428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396566-ab0b-47ae-a254-08ea1c6872e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.075856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3c396566-ab0b-47ae-a254-08ea1c6872e7 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:01.077075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3c396566-ab0b-47ae-a254-08ea1c6872e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:01.086296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1224/2468] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:29:01.090491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c396566-ab0b-47ae-a254-08ea1c6872e7 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:01.099652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c396566-ab0b-47ae-a254-08ea1c6872e7 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:01.105457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c2123-c2c1-43bd-b286-ff4859edb841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:01.106137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c2123-c2c1-43bd-b286-ff4859edb841 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.106416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c2123-c2c1-43bd-b286-ff4859edb841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.106691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c2123-c2c1-43bd-b286-ff4859edb841 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.107434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c2123-c2c1-43bd-b286-ff4859edb841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:29:01.107737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c2123-c2c1-43bd-b286-ff4859edb841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:01.109410 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c2123-c2c1-43bd-b286-ff4859edb841 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:01.115514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbd0d1-2837-4df6-9ed9-f6619c8ca3b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:01.117204 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbd0d1-2837-4df6-9ed9-f6619c8ca3b0 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:01.125439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1225/2469] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:29:01.127691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c2123-c2c1-43bd-b286-ff4859edb841 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:01.142099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c2123-c2c1-43bd-b286-ff4859edb841 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:01.144137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1245/2470] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:29:01.155604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3a708-c15d-4faf-a1b9-1804aa49b4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:01.156543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3a708-c15d-4faf-a1b9-1804aa49b4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.156913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3a708-c15d-4faf-a1b9-1804aa49b4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.158155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3a708-c15d-4faf-a1b9-1804aa49b4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.158155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3a708-c15d-4faf-a1b9-1804aa49b4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:01.160388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3a708-c15d-4faf-a1b9-1804aa49b4a5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:01.193003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1226/2471] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:29:01 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:29:01.198728 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbd0d1-2837-4df6-9ed9-f6619c8ca3b0 service nova] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:01.215466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbd0d1-2837-4df6-9ed9-f6619c8ca3b0 service nova] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:01.287580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d54b5-5d22-46cd-a3c2-c60aeb734ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:01.288350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d54b5-5d22-46cd-a3c2-c60aeb734ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.288941 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d54b5-5d22-46cd-a3c2-c60aeb734ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.289054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d54b5-5d22-46cd-a3c2-c60aeb734ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.289999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d54b5-5d22-46cd-a3c2-c60aeb734ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:01.292391 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d54b5-5d22-46cd-a3c2-c60aeb734ab4 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:01.321658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1246/2472] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:29:01 2022] POST /identity/v3/users => generated 282 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:29:01.325592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3a708-c15d-4faf-a1b9-1804aa49b4a5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:01.338048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3a708-c15d-4faf-a1b9-1804aa49b4a5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:01.343263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edf028-7584-4901-ac0c-3dc1ae848cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:01.343959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edf028-7584-4901-ac0c-3dc1ae848cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.344241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edf028-7584-4901-ac0c-3dc1ae848cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.344547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edf028-7584-4901-ac0c-3dc1ae848cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.345347 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edf028-7584-4901-ac0c-3dc1ae848cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:01.346988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edf028-7584-4901-ac0c-3dc1ae848cd9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:01.358456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1227/2473] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:29:01.363081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d54b5-5d22-46cd-a3c2-c60aeb734ab4 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:01.375512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d54b5-5d22-46cd-a3c2-c60aeb734ab4 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:01.380680 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fca09-9930-4f37-9ec1-5f99e4c7ff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:01.381381 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fca09-9930-4f37-9ec1-5f99e4c7ff73 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.381662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fca09-9930-4f37-9ec1-5f99e4c7ff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.381937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fca09-9930-4f37-9ec1-5f99e4c7ff73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.382773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fca09-9930-4f37-9ec1-5f99e4c7ff73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:01.384433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fca09-9930-4f37-9ec1-5f99e4c7ff73 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:01.396138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1247/2474] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:29:01.400806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edf028-7584-4901-ac0c-3dc1ae848cd9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:01.412119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edf028-7584-4901-ac0c-3dc1ae848cd9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:01.418021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e671940-34fc-403f-8c4c-dea422b151e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:01.419128 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671940-34fc-403f-8c4c-dea422b151e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.419598 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671940-34fc-403f-8c4c-dea422b151e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.419950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671940-34fc-403f-8c4c-dea422b151e2 admin admin] PATH_INFO: `/v3/projects/7b9f9dad40954385a12e6d163b760c5c/users/a9a22fe9301242e796c6af6ae40ba035/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.439134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e671940-34fc-403f-8c4c-dea422b151e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9f9dad40954385a12e6d163b760c5c, user_id=a9a22fe9301242e796c6af6ae40ba035, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:01.442301 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e671940-34fc-403f-8c4c-dea422b151e2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:01.462035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1228/2475] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:29:01 2022] PUT /identity/v3/projects/7b9f9dad40954385a12e6d163b760c5c/users/a9a22fe9301242e796c6af6ae40ba035/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:01.478263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c69c6-e508-4b15-8fd0-e0753efdd692 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.478741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c69c6-e508-4b15-8fd0-e0753efdd692 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.479245 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c69c6-e508-4b15-8fd0-e0753efdd692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.526807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-2c1c69c6-e508-4b15-8fd0-e0753efdd692 None None] MFA Rules not processed for user `a9a22fe9301242e796c6af6ae40ba035`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:01.528569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-2c1c69c6-e508-4b15-8fd0-e0753efdd692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:01.608701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1248/2476] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:01.613577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e671940-34fc-403f-8c4c-dea422b151e2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:01.716617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e671940-34fc-403f-8c4c-dea422b151e2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:01.724316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54f921-f13d-40d1-8f9b-0aae99226493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:01.724316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54f921-f13d-40d1-8f9b-0aae99226493 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.724316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54f921-f13d-40d1-8f9b-0aae99226493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.724316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54f921-f13d-40d1-8f9b-0aae99226493 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.724814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54f921-f13d-40d1-8f9b-0aae99226493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:01.725935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54f921-f13d-40d1-8f9b-0aae99226493 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:01.784111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1229/2477] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:29:01 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:29:01.789289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c69c6-e508-4b15-8fd0-e0753efdd692 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:01.804833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c69c6-e508-4b15-8fd0-e0753efdd692 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:01.888538 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0c21-b5a9-4a90-ad9d-bf76f16d83c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:01.889326 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0c21-b5a9-4a90-ad9d-bf76f16d83c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.889667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0c21-b5a9-4a90-ad9d-bf76f16d83c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.890009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd0c21-b5a9-4a90-ad9d-bf76f16d83c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.890935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd0c21-b5a9-4a90-ad9d-bf76f16d83c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:01.893437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd0c21-b5a9-4a90-ad9d-bf76f16d83c1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:01.927523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1249/2478] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:29:01 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:29:01.930015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54f921-f13d-40d1-8f9b-0aae99226493 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:01.957984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54f921-f13d-40d1-8f9b-0aae99226493 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:01.964678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298524-6e13-40c2-a5a7-cf49f5ef8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:01.965614 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298524-6e13-40c2-a5a7-cf49f5ef8588 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:01.966006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298524-6e13-40c2-a5a7-cf49f5ef8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:01.966374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298524-6e13-40c2-a5a7-cf49f5ef8588 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:01.967227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298524-6e13-40c2-a5a7-cf49f5ef8588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:01.969117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298524-6e13-40c2-a5a7-cf49f5ef8588 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:01.983679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1230/2479] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:29:01.984931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0c21-b5a9-4a90-ad9d-bf76f16d83c1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:02.003315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd0c21-b5a9-4a90-ad9d-bf76f16d83c1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:02.012673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2870f-5e44-44b1-8d54-e2591296f15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:02.014684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2870f-5e44-44b1-8d54-e2591296f15b admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:02.015300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2870f-5e44-44b1-8d54-e2591296f15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:02.015958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2870f-5e44-44b1-8d54-e2591296f15b admin admin] PATH_INFO: `/v3/projects/0cea09de90aa4848bda2c5b829d6977f/users/9f684467ce48402b98e88bd589e600f0/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:02.041066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2870f-5e44-44b1-8d54-e2591296f15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cea09de90aa4848bda2c5b829d6977f, user_id=9f684467ce48402b98e88bd589e600f0, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:02.045035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2870f-5e44-44b1-8d54-e2591296f15b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:02.062135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1250/2480] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:29:01 2022] PUT /identity/v3/projects/0cea09de90aa4848bda2c5b829d6977f/users/9f684467ce48402b98e88bd589e600f0/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:02.066210 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298524-6e13-40c2-a5a7-cf49f5ef8588 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:02.081603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298524-6e13-40c2-a5a7-cf49f5ef8588 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:02.154761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0cd91-27d3-4576-8065-b49993ac88ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:02.155431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0cd91-27d3-4576-8065-b49993ac88ef admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:02.155732 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0cd91-27d3-4576-8065-b49993ac88ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:02.156155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0cd91-27d3-4576-8065-b49993ac88ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:02.156759 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0cd91-27d3-4576-8065-b49993ac88ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:02.158395 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0cd91-27d3-4576-8065-b49993ac88ef admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:02.169940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1231/2481] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:29:02.174402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2870f-5e44-44b1-8d54-e2591296f15b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:02.186552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2870f-5e44-44b1-8d54-e2591296f15b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:02.192566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e9992-8fb5-448f-836e-513de5fb6174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:02.193843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9992-8fb5-448f-836e-513de5fb6174 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:02.194251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9992-8fb5-448f-836e-513de5fb6174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:02.194446 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9992-8fb5-448f-836e-513de5fb6174 admin admin] PATH_INFO: `/v3/projects/0cea09de90aa4848bda2c5b829d6977f/users/9f684467ce48402b98e88bd589e600f0/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:02.196630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e9992-8fb5-448f-836e-513de5fb6174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cea09de90aa4848bda2c5b829d6977f, user_id=9f684467ce48402b98e88bd589e600f0, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:02.199420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e9992-8fb5-448f-836e-513de5fb6174 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:02.212214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1251/2482] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:29:02 2022] PUT /identity/v3/projects/0cea09de90aa4848bda2c5b829d6977f/users/9f684467ce48402b98e88bd589e600f0/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:02.223327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e12afd-38eb-4e6c-8628-3142f8f4fc37 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:02.223672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e12afd-38eb-4e6c-8628-3142f8f4fc37 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:02.224789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e12afd-38eb-4e6c-8628-3142f8f4fc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:02.260980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-28e12afd-38eb-4e6c-8628-3142f8f4fc37 None None] MFA Rules not processed for user `9f684467ce48402b98e88bd589e600f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:02.262346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-28e12afd-38eb-4e6c-8628-3142f8f4fc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:02.360406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1232/2483] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:02.376873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e9992-8fb5-448f-836e-513de5fb6174 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:02.378629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-790e9992-8fb5-448f-836e-513de5fb6174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:02.447026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e9992-8fb5-448f-836e-513de5fb6174 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:02.452157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410c3b2-d44c-47a7-b3b6-b119e6a0faa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:02.454008 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410c3b2-d44c-47a7-b3b6-b119e6a0faa8 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:02.454358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410c3b2-d44c-47a7-b3b6-b119e6a0faa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:02.454785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410c3b2-d44c-47a7-b3b6-b119e6a0faa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:02.471586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410c3b2-d44c-47a7-b3b6-b119e6a0faa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:02.473699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410c3b2-d44c-47a7-b3b6-b119e6a0faa8 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:02.491644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1252/2484] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:29:02.589872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e12afd-38eb-4e6c-8628-3142f8f4fc37 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:02.600352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e12afd-38eb-4e6c-8628-3142f8f4fc37 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:02.604058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1f0c8-332e-4d99-a6dd-bd57cf8ad143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:02.604745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1f0c8-332e-4d99-a6dd-bd57cf8ad143 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:02.605022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1f0c8-332e-4d99-a6dd-bd57cf8ad143 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:02.605331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1f0c8-332e-4d99-a6dd-bd57cf8ad143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:02.671482 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1f0c8-332e-4d99-a6dd-bd57cf8ad143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:02.673016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1f0c8-332e-4d99-a6dd-bd57cf8ad143 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:02.682054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1233/2485] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:29:02.854322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9061-8cb6-479d-802d-54e73fb4d143 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:02.854873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9061-8cb6-479d-802d-54e73fb4d143 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:02.854873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f9061-8cb6-479d-802d-54e73fb4d143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:02.878784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-046f9061-8cb6-479d-802d-54e73fb4d143 None None] MFA Rules not processed for user `f02cd9096152479da885ead20d3ec061`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:02.880655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-046f9061-8cb6-479d-802d-54e73fb4d143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:02.951511 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1253/2486] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:07.972065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1f0c8-332e-4d99-a6dd-bd57cf8ad143 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:08.056262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1f0c8-332e-4d99-a6dd-bd57cf8ad143 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:08.063460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:08.064710 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:08.065402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:08.065829 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] PATH_INFO: `/v3/users/a9a22fe9301242e796c6af6ae40ba035` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:08.067189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a22fe9301242e796c6af6ae40ba035)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:08.069198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:08.133020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a22fe9301242e796c6af6ae40ba035'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:08.140426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a22fe9301242e796c6af6ae40ba035'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:08.154185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a22fe9301242e796c6af6ae40ba035'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:08.154936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a22fe9301242e796c6af6ae40ba035'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:08.164904 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a22fe9301242e796c6af6ae40ba035'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:08.174203 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1234/2487] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:29:07 2022] DELETE /identity/v3/users/a9a22fe9301242e796c6af6ae40ba035 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:08.180371 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31ad86-c8fe-46da-9dce-d33890e0a81f None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:08.181280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31ad86-c8fe-46da-9dce-d33890e0a81f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:08.181280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31ad86-c8fe-46da-9dce-d33890e0a81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:08.202939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-6d31ad86-c8fe-46da-9dce-d33890e0a81f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:08.204360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6d31ad86-c8fe-46da-9dce-d33890e0a81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:08.277822 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1254/2488] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:08.291380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:08.293492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:08.378551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be3d92-9898-428e-88df-1665d3ce3069 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:08.383133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa9230-7686-4159-a76a-63c0cc7bee1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:08.383888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa9230-7686-4159-a76a-63c0cc7bee1b service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:08.384071 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa9230-7686-4159-a76a-63c0cc7bee1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:08.384343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa9230-7686-4159-a76a-63c0cc7bee1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:08.395845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa9230-7686-4159-a76a-63c0cc7bee1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:08.397657 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa9230-7686-4159-a76a-63c0cc7bee1b service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:08.410786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1235/2489] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:29:08.788096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31ad86-c8fe-46da-9dce-d33890e0a81f None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:08.789971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6d31ad86-c8fe-46da-9dce-d33890e0a81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:08.810354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31ad86-c8fe-46da-9dce-d33890e0a81f None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:08.816208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:08.820344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:08.820344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:08.820344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] PATH_INFO: `/v3/projects/7b9f9dad40954385a12e6d163b760c5c` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:08.820991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9f9dad40954385a12e6d163b760c5c)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:08.824548 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:08.881637 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9f9dad40954385a12e6d163b760c5c', 'request_id': 'req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:08.889064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9f9dad40954385a12e6d163b760c5c', 'request_id': 'req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:08.895670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9f9dad40954385a12e6d163b760c5c', 'request_id': 'req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:08.909798 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] The token cache is being invalidate because project 7b9f9dad40954385a12e6d163b760c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:29:08.910121 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:08.910791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:08.912420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1255/2490] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:29:08 2022] DELETE /identity/v3/projects/7b9f9dad40954385a12e6d163b760c5c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:08.916665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa9230-7686-4159-a76a-63c0cc7bee1b service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:08.927803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa9230-7686-4159-a76a-63c0cc7bee1b service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:08.994134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:08.995414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:08.995692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:08.996079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] PATH_INFO: `/v3/users/9f684467ce48402b98e88bd589e600f0` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:08.997378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f684467ce48402b98e88bd589e600f0)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:08.999295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:09.057434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f684467ce48402b98e88bd589e600f0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:09.065514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f684467ce48402b98e88bd589e600f0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:09.080889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f684467ce48402b98e88bd589e600f0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:09.081963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f684467ce48402b98e88bd589e600f0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:09.092640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-b17bdf7b-4378-4c4d-b6e8-4c69b644ff87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f684467ce48402b98e88bd589e600f0'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:09.100407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1236/2491] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:29:08 2022] DELETE /identity/v3/users/9f684467ce48402b98e88bd589e600f0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:09.363225 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:09.364723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:09.381658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b0ccd-ab53-4091-82a1-4ac5a10f0c19 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:09.439464 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:09.440347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:09.440625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:09.440895 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] PATH_INFO: `/v3/projects/0cea09de90aa4848bda2c5b829d6977f` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:09.442121 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cea09de90aa4848bda2c5b829d6977f)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:09.444021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:09.497033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cea09de90aa4848bda2c5b829d6977f', 'request_id': 'req-357bfeaf-5168-4083-964e-e412107f43ec'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:09.503398 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cea09de90aa4848bda2c5b829d6977f', 'request_id': 'req-357bfeaf-5168-4083-964e-e412107f43ec'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:09.510672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cea09de90aa4848bda2c5b829d6977f', 'request_id': 'req-357bfeaf-5168-4083-964e-e412107f43ec'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:09.523875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] The token cache is being invalidate because project 0cea09de90aa4848bda2c5b829d6977f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:29:09.524158 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:09.524786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-357bfeaf-5168-4083-964e-e412107f43ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:09.526364 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1256/2492] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:29:09 2022] DELETE /identity/v3/projects/0cea09de90aa4848bda2c5b829d6977f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:09.532164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d4fa-c596-478a-ac9d-3d1b6896d8fd None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:09.532456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d4fa-c596-478a-ac9d-3d1b6896d8fd None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:09.532732 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d4fa-c596-478a-ac9d-3d1b6896d8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:09.552851 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-f055d4fa-c596-478a-ac9d-3d1b6896d8fd None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:09.554827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f055d4fa-c596-478a-ac9d-3d1b6896d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:09.629413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1237/2493] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:29:09.637560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a16e-3059-4fd3-85ef-5ea1cc02d4f0 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:09.637856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a16e-3059-4fd3-85ef-5ea1cc02d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:09.638158 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0a16e-3059-4fd3-85ef-5ea1cc02d4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:09.658045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-a1c0a16e-3059-4fd3-85ef-5ea1cc02d4f0 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:09.659298 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a1c0a16e-3059-4fd3-85ef-5ea1cc02d4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:09.668656 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1257/2494] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:09.674342 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d4fa-c596-478a-ac9d-3d1b6896d8fd None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:09.687290 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d4fa-c596-478a-ac9d-3d1b6896d8fd None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:09.693825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28927881-4283-4add-891b-5247a7dfa5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:09.695031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28927881-4283-4add-891b-5247a7dfa5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:09.695443 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28927881-4283-4add-891b-5247a7dfa5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:09.695812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28927881-4283-4add-891b-5247a7dfa5b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:09.696669 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28927881-4283-4add-891b-5247a7dfa5b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:29:09.697062 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28927881-4283-4add-891b-5247a7dfa5b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:09.698816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28927881-4283-4add-891b-5247a7dfa5b0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:09.718672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1238/2495] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:29:09.724268 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0a16e-3059-4fd3-85ef-5ea1cc02d4f0 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:09.734793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0a16e-3059-4fd3-85ef-5ea1cc02d4f0 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:09.740937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41d033-7802-40f6-a009-619e80ad2847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:09.741927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41d033-7802-40f6-a009-619e80ad2847 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:09.742462 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41d033-7802-40f6-a009-619e80ad2847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:09.742736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41d033-7802-40f6-a009-619e80ad2847 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:09.743443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41d033-7802-40f6-a009-619e80ad2847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:09.745373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41d033-7802-40f6-a009-619e80ad2847 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:09.775832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1258/2496] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:29:09 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:29:09.780224 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28927881-4283-4add-891b-5247a7dfa5b0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:09.794997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28927881-4283-4add-891b-5247a7dfa5b0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:09.862467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ba87f-84a0-4daa-8fe6-b804c9b1305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:09.863651 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ba87f-84a0-4daa-8fe6-b804c9b1305a admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:09.864564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ba87f-84a0-4daa-8fe6-b804c9b1305a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:09.865169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ba87f-84a0-4daa-8fe6-b804c9b1305a admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:09.866726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ba87f-84a0-4daa-8fe6-b804c9b1305a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:09.869809 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ba87f-84a0-4daa-8fe6-b804c9b1305a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:09.895459 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1239/2497] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:29:09 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:29:09.899569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41d033-7802-40f6-a009-619e80ad2847 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:09.913569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41d033-7802-40f6-a009-619e80ad2847 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:09.919919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134d126-39f2-49ed-9673-a998e15bd12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:09.920681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134d126-39f2-49ed-9673-a998e15bd12f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:09.921097 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134d126-39f2-49ed-9673-a998e15bd12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:09.921357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134d126-39f2-49ed-9673-a998e15bd12f admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:09.922135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134d126-39f2-49ed-9673-a998e15bd12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:09.923793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134d126-39f2-49ed-9673-a998e15bd12f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:09.937374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1259/2498] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:29:09.940444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ba87f-84a0-4daa-8fe6-b804c9b1305a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:09.951324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ba87f-84a0-4daa-8fe6-b804c9b1305a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:09.956404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a15ddb-3749-4e7d-959d-6042e5115994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:09.957060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a15ddb-3749-4e7d-959d-6042e5115994 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:09.957368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a15ddb-3749-4e7d-959d-6042e5115994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:09.957664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a15ddb-3749-4e7d-959d-6042e5115994 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:09.958398 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a15ddb-3749-4e7d-959d-6042e5115994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:09.959964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a15ddb-3749-4e7d-959d-6042e5115994 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:09.970086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1240/2499] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:29:09.976184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134d126-39f2-49ed-9673-a998e15bd12f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:09.991875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134d126-39f2-49ed-9673-a998e15bd12f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:09.997682 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de9eaf-8399-41db-8eae-7ab86741a6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:09.998930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9eaf-8399-41db-8eae-7ab86741a6ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:09.999159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9eaf-8399-41db-8eae-7ab86741a6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:09.999564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de9eaf-8399-41db-8eae-7ab86741a6ba admin admin] PATH_INFO: `/v3/projects/fe208dda208e4bc8ae076c867c9861b7/users/f986b00ff00a4561a7bed7d4c1750df5/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:10.017271 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de9eaf-8399-41db-8eae-7ab86741a6ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe208dda208e4bc8ae076c867c9861b7, user_id=f986b00ff00a4561a7bed7d4c1750df5, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:10.021720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de9eaf-8399-41db-8eae-7ab86741a6ba admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:10.038818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1260/2500] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:29:09 2022] PUT /identity/v3/projects/fe208dda208e4bc8ae076c867c9861b7/users/f986b00ff00a4561a7bed7d4c1750df5/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:10.052485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f1eb1-5d01-49a0-af72-292584dacac6 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:10.053153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f1eb1-5d01-49a0-af72-292584dacac6 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:10.053153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f1eb1-5d01-49a0-af72-292584dacac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:10.085159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-e50f1eb1-5d01-49a0-af72-292584dacac6 None None] MFA Rules not processed for user `f986b00ff00a4561a7bed7d4c1750df5`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:10.086597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e50f1eb1-5d01-49a0-af72-292584dacac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:10.152891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1241/2501] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:10.157684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de9eaf-8399-41db-8eae-7ab86741a6ba admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:10.221186 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de9eaf-8399-41db-8eae-7ab86741a6ba admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:10.226004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a12633-cdf3-40b3-9046-37a17c3c9499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:10.226756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12633-cdf3-40b3-9046-37a17c3c9499 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:10.227044 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12633-cdf3-40b3-9046-37a17c3c9499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:10.227322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a12633-cdf3-40b3-9046-37a17c3c9499 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:10.228123 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a12633-cdf3-40b3-9046-37a17c3c9499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:10.230339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a12633-cdf3-40b3-9046-37a17c3c9499 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:10.257111 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1261/2502] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:29:10 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:29:10.261962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f1eb1-5d01-49a0-af72-292584dacac6 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:10.274311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f1eb1-5d01-49a0-af72-292584dacac6 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:10.340825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c139970-7a7d-4ebc-8136-22a38db8fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:10.341505 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c139970-7a7d-4ebc-8136-22a38db8fa5c admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:10.341806 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c139970-7a7d-4ebc-8136-22a38db8fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:10.342078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c139970-7a7d-4ebc-8136-22a38db8fa5c admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:10.342782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c139970-7a7d-4ebc-8136-22a38db8fa5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:10.344712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c139970-7a7d-4ebc-8136-22a38db8fa5c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:10.366776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1242/2503] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:29:10 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:29:10.371835 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a12633-cdf3-40b3-9046-37a17c3c9499 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:10.387117 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a12633-cdf3-40b3-9046-37a17c3c9499 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:10.393088 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d5861-ce55-4a1a-9b85-eabbf9a2e147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:10.393785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d5861-ce55-4a1a-9b85-eabbf9a2e147 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:10.394086 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d5861-ce55-4a1a-9b85-eabbf9a2e147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:10.394455 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d5861-ce55-4a1a-9b85-eabbf9a2e147 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:10.395199 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d5861-ce55-4a1a-9b85-eabbf9a2e147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:10.396806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d5861-ce55-4a1a-9b85-eabbf9a2e147 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:10.408529 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1262/2504] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:29:10.414066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c139970-7a7d-4ebc-8136-22a38db8fa5c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:10.425246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c139970-7a7d-4ebc-8136-22a38db8fa5c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:10.429913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d13a7-3595-4610-8385-c03a1b419b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:10.430790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d13a7-3595-4610-8385-c03a1b419b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:10.431063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d13a7-3595-4610-8385-c03a1b419b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:10.431331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d13a7-3595-4610-8385-c03a1b419b1a admin admin] PATH_INFO: `/v3/projects/af0441b77fd54c7a86966ac7fb965d34/users/afca37fd64884d64870279f4d574ac49/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:10.448885 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d13a7-3595-4610-8385-c03a1b419b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0441b77fd54c7a86966ac7fb965d34, user_id=afca37fd64884d64870279f4d574ac49, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:10.451577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d13a7-3595-4610-8385-c03a1b419b1a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:10.465897 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1243/2505] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:29:10 2022] PUT /identity/v3/projects/af0441b77fd54c7a86966ac7fb965d34/users/afca37fd64884d64870279f4d574ac49/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:29:10.470619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d5861-ce55-4a1a-9b85-eabbf9a2e147 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:10.482687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d5861-ce55-4a1a-9b85-eabbf9a2e147 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:10.544994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c8bd0-c818-4db4-bd55-0c06119dad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:10.545705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c8bd0-c818-4db4-bd55-0c06119dad7e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:10.545996 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c8bd0-c818-4db4-bd55-0c06119dad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:10.546276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c8bd0-c818-4db4-bd55-0c06119dad7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:10.547023 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c8bd0-c818-4db4-bd55-0c06119dad7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:10.548624 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c8bd0-c818-4db4-bd55-0c06119dad7e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:10.560598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1263/2506] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:29:10.565906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d13a7-3595-4610-8385-c03a1b419b1a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:10.576410 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d13a7-3595-4610-8385-c03a1b419b1a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:10.581487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ece9fe-c2ad-488d-aeba-6deb04b30987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:10.582401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ece9fe-c2ad-488d-aeba-6deb04b30987 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:10.582683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ece9fe-c2ad-488d-aeba-6deb04b30987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:10.582956 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ece9fe-c2ad-488d-aeba-6deb04b30987 admin admin] PATH_INFO: `/v3/projects/af0441b77fd54c7a86966ac7fb965d34/users/afca37fd64884d64870279f4d574ac49/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:10.584999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ece9fe-c2ad-488d-aeba-6deb04b30987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0441b77fd54c7a86966ac7fb965d34, user_id=afca37fd64884d64870279f4d574ac49, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:10.587767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ece9fe-c2ad-488d-aeba-6deb04b30987 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:10.601000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1244/2507] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:29:10 2022] PUT /identity/v3/projects/af0441b77fd54c7a86966ac7fb965d34/users/afca37fd64884d64870279f4d574ac49/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:29:10.616160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab769d-5ddc-4139-a20c-f12fbada9d1a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:10.616449 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab769d-5ddc-4139-a20c-f12fbada9d1a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:10.616720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab769d-5ddc-4139-a20c-f12fbada9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:10.646751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-35ab769d-5ddc-4139-a20c-f12fbada9d1a None None] MFA Rules not processed for user `afca37fd64884d64870279f4d574ac49`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:10.648211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-35ab769d-5ddc-4139-a20c-f12fbada9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:10.727820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1264/2508] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:10.737547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ece9fe-c2ad-488d-aeba-6deb04b30987 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:10.739545 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-01ece9fe-c2ad-488d-aeba-6deb04b30987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:10.810766 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ece9fe-c2ad-488d-aeba-6deb04b30987 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:10.816027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd0d3e-467c-44b1-9f46-a55a982154f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:10.816836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd0d3e-467c-44b1-9f46-a55a982154f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:10.817115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd0d3e-467c-44b1-9f46-a55a982154f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:10.817467 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd0d3e-467c-44b1-9f46-a55a982154f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:10.877923 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd0d3e-467c-44b1-9f46-a55a982154f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:10.879363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd0d3e-467c-44b1-9f46-a55a982154f5 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:10.888586 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1245/2509] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:29:15.211661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab769d-5ddc-4139-a20c-f12fbada9d1a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:15.213201 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-35ab769d-5ddc-4139-a20c-f12fbada9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:15.233502 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab769d-5ddc-4139-a20c-f12fbada9d1a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:15.237340 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efec41c-1d34-4dfe-ae24-9f4be15f4cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:15.237975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec41c-1d34-4dfe-ae24-9f4be15f4cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:15.238249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec41c-1d34-4dfe-ae24-9f4be15f4cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:15.238512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efec41c-1d34-4dfe-ae24-9f4be15f4cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:15.248746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efec41c-1d34-4dfe-ae24-9f4be15f4cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:15.249892 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efec41c-1d34-4dfe-ae24-9f4be15f4cf2 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:15.265540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1265/2510] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:29:20.260353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd0d3e-467c-44b1-9f46-a55a982154f5 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:20.330674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd0d3e-467c-44b1-9f46-a55a982154f5 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:20.335668 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:20.336542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:20.336821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:20.337095 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] PATH_INFO: `/v3/users/f986b00ff00a4561a7bed7d4c1750df5` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:20.338385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f986b00ff00a4561a7bed7d4c1750df5)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:20.340319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:20.389784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f986b00ff00a4561a7bed7d4c1750df5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:20.397202 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f986b00ff00a4561a7bed7d4c1750df5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:20.410470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f986b00ff00a4561a7bed7d4c1750df5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:20.411297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f986b00ff00a4561a7bed7d4c1750df5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:20.419651 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f986b00ff00a4561a7bed7d4c1750df5'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:20.426020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1246/2511] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:29:20 2022] DELETE /identity/v3/users/f986b00ff00a4561a7bed7d4c1750df5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:20.431008 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cf617-1614-4ee2-93e6-1f7272f2d8ba None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:20.431807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cf617-1614-4ee2-93e6-1f7272f2d8ba None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:20.431807 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cf617-1614-4ee2-93e6-1f7272f2d8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:20.452011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-356cf617-1614-4ee2-93e6-1f7272f2d8ba None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:20.453213 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-356cf617-1614-4ee2-93e6-1f7272f2d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:20.516130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1266/2512] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:20.526148 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:20.527740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:20.591448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdfe86-98ad-4296-98a1-47fefe7e5845 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:20.595455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f49a56-8ddb-4d95-9443-e2f1ad772b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:20.596097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f49a56-8ddb-4d95-9443-e2f1ad772b31 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:20.596370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f49a56-8ddb-4d95-9443-e2f1ad772b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:20.596637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f49a56-8ddb-4d95-9443-e2f1ad772b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:20.606118 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f49a56-8ddb-4d95-9443-e2f1ad772b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:20.607541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f49a56-8ddb-4d95-9443-e2f1ad772b31 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:20.617767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1247/2513] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:29:20.914892 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cf617-1614-4ee2-93e6-1f7272f2d8ba None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:20.919694 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-356cf617-1614-4ee2-93e6-1f7272f2d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:20.935644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cf617-1614-4ee2-93e6-1f7272f2d8ba None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:20.940540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:20.941450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:20.941913 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:20.942050 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] PATH_INFO: `/v3/projects/fe208dda208e4bc8ae076c867c9861b7` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:20.943199 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe208dda208e4bc8ae076c867c9861b7)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:20.945213 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:20.999138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe208dda208e4bc8ae076c867c9861b7', 'request_id': 'req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.006723 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe208dda208e4bc8ae076c867c9861b7', 'request_id': 'req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.013321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe208dda208e4bc8ae076c867c9861b7', 'request_id': 'req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.028359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] The token cache is being invalidate because project fe208dda208e4bc8ae076c867c9861b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:29:21.028716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.029676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.031330 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1267/2514] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:29:20 2022] DELETE /identity/v3/projects/fe208dda208e4bc8ae076c867c9861b7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:29:21.035747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f49a56-8ddb-4d95-9443-e2f1ad772b31 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:21.046110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f49a56-8ddb-4d95-9443-e2f1ad772b31 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:21.123169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:21.124055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:21.124326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:21.124592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] PATH_INFO: `/v3/users/afca37fd64884d64870279f4d574ac49` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:21.125848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afca37fd64884d64870279f4d574ac49)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:21.127767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:21.188500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afca37fd64884d64870279f4d574ac49'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.195922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afca37fd64884d64870279f4d574ac49'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.208155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afca37fd64884d64870279f4d574ac49'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.208893 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afca37fd64884d64870279f4d574ac49'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.217676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6acd2a5b-fe37-4f84-9a71-a7e52563eb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afca37fd64884d64870279f4d574ac49'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.225042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1248/2515] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:29:21 2022] DELETE /identity/v3/users/afca37fd64884d64870279f4d574ac49 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:29:21.521344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:21.523610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:21.544116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ecdcc-cb4f-4850-993f-44b49b2c18e7 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:21.613857 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:21.614622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:21.614900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:21.615167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] PATH_INFO: `/v3/projects/af0441b77fd54c7a86966ac7fb965d34` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:21.616399 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0441b77fd54c7a86966ac7fb965d34)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:21.618392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:21.668150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0441b77fd54c7a86966ac7fb965d34', 'request_id': 'req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.674727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0441b77fd54c7a86966ac7fb965d34', 'request_id': 'req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.680630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0441b77fd54c7a86966ac7fb965d34', 'request_id': 'req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.703931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] The token cache is being invalidate because project af0441b77fd54c7a86966ac7fb965d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:29:21.703931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.705109 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-7a65c161-f6f2-4ffb-897a-13d6e51fec7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:21.706705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1268/2516] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:29:21 2022] DELETE /identity/v3/projects/af0441b77fd54c7a86966ac7fb965d34 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:21.713719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602363f-925b-460f-9b12-2924d6a1c7c3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:21.714469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602363f-925b-460f-9b12-2924d6a1c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:21.714469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602363f-925b-460f-9b12-2924d6a1c7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:21.734102 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a602363f-925b-460f-9b12-2924d6a1c7c3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:21.735326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a602363f-925b-460f-9b12-2924d6a1c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:21.804649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1249/2517] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:21.813260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593d74-8559-432d-b024-2b41fe7cfa04 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:21.813678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593d74-8559-432d-b024-2b41fe7cfa04 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:21.814182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593d74-8559-432d-b024-2b41fe7cfa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:21.834665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-de593d74-8559-432d-b024-2b41fe7cfa04 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:21.835977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-de593d74-8559-432d-b024-2b41fe7cfa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:21.845056 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1269/2518] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:21.849625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602363f-925b-460f-9b12-2924d6a1c7c3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:21.860054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602363f-925b-460f-9b12-2924d6a1c7c3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:21.866351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837da3-473c-48bb-aae0-a7f65b140e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:21.867309 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837da3-473c-48bb-aae0-a7f65b140e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:21.867599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837da3-473c-48bb-aae0-a7f65b140e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:21.867872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837da3-473c-48bb-aae0-a7f65b140e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:21.868619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4837da3-473c-48bb-aae0-a7f65b140e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:29:21.868925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4837da3-473c-48bb-aae0-a7f65b140e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:21.870635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4837da3-473c-48bb-aae0-a7f65b140e94 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:21.883119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1250/2519] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:29:21.890030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593d74-8559-432d-b024-2b41fe7cfa04 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:21.905121 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593d74-8559-432d-b024-2b41fe7cfa04 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:21.912605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b38d4-8c39-4d56-bce7-f44e321e682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:21.913569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b38d4-8c39-4d56-bce7-f44e321e682b admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:21.914021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b38d4-8c39-4d56-bce7-f44e321e682b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:21.914470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b38d4-8c39-4d56-bce7-f44e321e682b admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:21.915870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b38d4-8c39-4d56-bce7-f44e321e682b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:21.919292 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b38d4-8c39-4d56-bce7-f44e321e682b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:21.955922 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1270/2520] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:29:21 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:29:21.960026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837da3-473c-48bb-aae0-a7f65b140e94 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:21.970462 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837da3-473c-48bb-aae0-a7f65b140e94 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:22.032021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fc908-743b-45bb-95fb-974063d7cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:22.032669 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fc908-743b-45bb-95fb-974063d7cd14 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:22.032948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fc908-743b-45bb-95fb-974063d7cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:22.033221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fc908-743b-45bb-95fb-974063d7cd14 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:22.033979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fc908-743b-45bb-95fb-974063d7cd14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:22.036215 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fc908-743b-45bb-95fb-974063d7cd14 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:22.057423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1251/2521] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:29:21 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:29:22.061789 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b38d4-8c39-4d56-bce7-f44e321e682b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:22.074234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b38d4-8c39-4d56-bce7-f44e321e682b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:22.080673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c6fab-8313-46b4-b06d-29fdbd5c0feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:22.081397 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6fab-8313-46b4-b06d-29fdbd5c0feb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:22.081688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6fab-8313-46b4-b06d-29fdbd5c0feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:22.081963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6fab-8313-46b4-b06d-29fdbd5c0feb admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:22.082714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c6fab-8313-46b4-b06d-29fdbd5c0feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:22.084345 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c6fab-8313-46b4-b06d-29fdbd5c0feb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:22.096380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1271/2522] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:29:22.100471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fc908-743b-45bb-95fb-974063d7cd14 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:22.112541 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fc908-743b-45bb-95fb-974063d7cd14 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:22.118395 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd328b-44b1-433e-867a-090335e44793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:22.119025 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd328b-44b1-433e-867a-090335e44793 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:22.119312 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd328b-44b1-433e-867a-090335e44793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:22.119606 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd328b-44b1-433e-867a-090335e44793 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:22.120357 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd328b-44b1-433e-867a-090335e44793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:22.121983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd328b-44b1-433e-867a-090335e44793 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:22.133905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1252/2523] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:29:22.139273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c6fab-8313-46b4-b06d-29fdbd5c0feb admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:22.149998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c6fab-8313-46b4-b06d-29fdbd5c0feb admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:22.155163 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622a730-6250-4c98-af8b-e626e1401dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:22.156114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a730-6250-4c98-af8b-e626e1401dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:22.156319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a730-6250-4c98-af8b-e626e1401dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:22.156596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622a730-6250-4c98-af8b-e626e1401dcf admin admin] PATH_INFO: `/v3/projects/13a15f40aa394fc7b6cfb57bf71dff8a/users/af283256dfc94594920c03364e3a8bdb/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:22.180001 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622a730-6250-4c98-af8b-e626e1401dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a15f40aa394fc7b6cfb57bf71dff8a, user_id=af283256dfc94594920c03364e3a8bdb, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:22.182773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622a730-6250-4c98-af8b-e626e1401dcf admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:22.197815 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1272/2524] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:29:22 2022] PUT /identity/v3/projects/13a15f40aa394fc7b6cfb57bf71dff8a/users/af283256dfc94594920c03364e3a8bdb/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:22.213003 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96d66c-3969-4e5c-8037-0e7288f5947a None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:22.213434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96d66c-3969-4e5c-8037-0e7288f5947a None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:22.213871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96d66c-3969-4e5c-8037-0e7288f5947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:22.248981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2a96d66c-3969-4e5c-8037-0e7288f5947a None None] MFA Rules not processed for user `af283256dfc94594920c03364e3a8bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:22.251358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2a96d66c-3969-4e5c-8037-0e7288f5947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:22.338434 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1253/2525] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:29:22.350218 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622a730-6250-4c98-af8b-e626e1401dcf admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:22.352241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a622a730-6250-4c98-af8b-e626e1401dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:22.413099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622a730-6250-4c98-af8b-e626e1401dcf admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:22.417107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49e334-b250-4ccb-a436-15e21abd064a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:22.417800 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49e334-b250-4ccb-a436-15e21abd064a service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:22.418072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49e334-b250-4ccb-a436-15e21abd064a service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:22.418343 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49e334-b250-4ccb-a436-15e21abd064a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:22.427883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49e334-b250-4ccb-a436-15e21abd064a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:22.429396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49e334-b250-4ccb-a436-15e21abd064a service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:22.439824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1273/2526] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:29:42.321252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96d66c-3969-4e5c-8037-0e7288f5947a None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:42.389882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96d66c-3969-4e5c-8037-0e7288f5947a None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:42.394765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:42.395651 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:42.395954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:42.396198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] PATH_INFO: `/v3/users/af283256dfc94594920c03364e3a8bdb` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:42.397767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af283256dfc94594920c03364e3a8bdb)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:42.399684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:42.451425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af283256dfc94594920c03364e3a8bdb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:42.461409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af283256dfc94594920c03364e3a8bdb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:42.473546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af283256dfc94594920c03364e3a8bdb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:42.476204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af283256dfc94594920c03364e3a8bdb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:42.486639 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af283256dfc94594920c03364e3a8bdb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:42.493097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1254/2527] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:29:42 2022] DELETE /identity/v3/users/af283256dfc94594920c03364e3a8bdb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:42.498190 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e862a38-c266-4cda-be17-321d5c6fe4d4 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:42.498749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e862a38-c266-4cda-be17-321d5c6fe4d4 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:42.498749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e862a38-c266-4cda-be17-321d5c6fe4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:42.516148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1e862a38-c266-4cda-be17-321d5c6fe4d4 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:42.517358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1e862a38-c266-4cda-be17-321d5c6fe4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:42.578017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1274/2528] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:29:42.591268 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:42.592893 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:42.659380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b1a2e-66a3-4e4d-9b87-53dae6b43bc2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:42.663294 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e34c2-cbf8-4e7b-8021-1d1e71284b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:42.664009 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e34c2-cbf8-4e7b-8021-1d1e71284b00 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:42.664295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e34c2-cbf8-4e7b-8021-1d1e71284b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:42.664572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e34c2-cbf8-4e7b-8021-1d1e71284b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:42.676388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e34c2-cbf8-4e7b-8021-1d1e71284b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:42.677913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e34c2-cbf8-4e7b-8021-1d1e71284b00 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:42.690669 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1255/2529] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:29:42.979910 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e862a38-c266-4cda-be17-321d5c6fe4d4 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:42.981392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1e862a38-c266-4cda-be17-321d5c6fe4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:42.994667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e862a38-c266-4cda-be17-321d5c6fe4d4 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:43.001996 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:43.003485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.003739 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.004159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] PATH_INFO: `/v3/projects/13a15f40aa394fc7b6cfb57bf71dff8a` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.006848 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a15f40aa394fc7b6cfb57bf71dff8a)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:43.009251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:43.070424 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a15f40aa394fc7b6cfb57bf71dff8a', 'request_id': 'req-12aa91de-1a31-4c97-a0f2-da9575e91601'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:43.080946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a15f40aa394fc7b6cfb57bf71dff8a', 'request_id': 'req-12aa91de-1a31-4c97-a0f2-da9575e91601'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:43.089252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a15f40aa394fc7b6cfb57bf71dff8a', 'request_id': 'req-12aa91de-1a31-4c97-a0f2-da9575e91601'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:43.103823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] The token cache is being invalidate because project 13a15f40aa394fc7b6cfb57bf71dff8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:29:43.104116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:43.104963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-12aa91de-1a31-4c97-a0f2-da9575e91601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:29:43.110971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1275/2530] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:29:42 2022] DELETE /identity/v3/projects/13a15f40aa394fc7b6cfb57bf71dff8a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:43.119277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c9dde-a92d-435c-8837-d9a632b5f473 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.119569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c9dde-a92d-435c-8837-d9a632b5f473 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.119847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c9dde-a92d-435c-8837-d9a632b5f473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.139198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-295c9dde-a92d-435c-8837-d9a632b5f473 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:43.140543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-295c9dde-a92d-435c-8837-d9a632b5f473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:43.206741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1256/2531] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:43.215055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7d7a-6928-47be-83c0-6d170257a10a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.215339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7d7a-6928-47be-83c0-6d170257a10a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.215612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7d7a-6928-47be-83c0-6d170257a10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.236879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-a81b7d7a-6928-47be-83c0-6d170257a10a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:43.238167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a81b7d7a-6928-47be-83c0-6d170257a10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:43.246879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1276/2532] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:43.251627 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c9dde-a92d-435c-8837-d9a632b5f473 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:43.262189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c9dde-a92d-435c-8837-d9a632b5f473 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:43.267196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbc9bb-d5fd-4f68-baf5-b17d9c0fa45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:43.267868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbc9bb-d5fd-4f68-baf5-b17d9c0fa45c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.268141 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbc9bb-d5fd-4f68-baf5-b17d9c0fa45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.268415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbc9bb-d5fd-4f68-baf5-b17d9c0fa45c admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.269163 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbc9bb-d5fd-4f68-baf5-b17d9c0fa45c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:29:43.269501 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbc9bb-d5fd-4f68-baf5-b17d9c0fa45c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:43.271101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbc9bb-d5fd-4f68-baf5-b17d9c0fa45c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:43.283261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1257/2533] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:29:43.287729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b7d7a-6928-47be-83c0-6d170257a10a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:43.302102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b7d7a-6928-47be-83c0-6d170257a10a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:43.308858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535895c-4c66-4e37-b289-bd322aa14aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:43.309570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535895c-4c66-4e37-b289-bd322aa14aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.309936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535895c-4c66-4e37-b289-bd322aa14aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.310212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535895c-4c66-4e37-b289-bd322aa14aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.310927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535895c-4c66-4e37-b289-bd322aa14aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:43.312869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535895c-4c66-4e37-b289-bd322aa14aa0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:43.344137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1277/2534] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:29:43 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:29:43.348458 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbc9bb-d5fd-4f68-baf5-b17d9c0fa45c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:43.359039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbc9bb-d5fd-4f68-baf5-b17d9c0fa45c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:43.435766 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e5fa9-69e6-4d42-9dc5-bc7db37a2eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:43.436416 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e5fa9-69e6-4d42-9dc5-bc7db37a2eea admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.436683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e5fa9-69e6-4d42-9dc5-bc7db37a2eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.436984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e5fa9-69e6-4d42-9dc5-bc7db37a2eea admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.437736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e5fa9-69e6-4d42-9dc5-bc7db37a2eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:43.439715 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e5fa9-69e6-4d42-9dc5-bc7db37a2eea admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:43.462487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1258/2535] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:29:43 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:29:43.467518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535895c-4c66-4e37-b289-bd322aa14aa0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:43.484405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535895c-4c66-4e37-b289-bd322aa14aa0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:43.493690 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040a0d4-7aac-4002-82a4-3e8dc7c1b9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:43.494989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040a0d4-7aac-4002-82a4-3e8dc7c1b9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.495510 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040a0d4-7aac-4002-82a4-3e8dc7c1b9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.495891 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040a0d4-7aac-4002-82a4-3e8dc7c1b9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.497559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040a0d4-7aac-4002-82a4-3e8dc7c1b9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:43.500936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040a0d4-7aac-4002-82a4-3e8dc7c1b9b0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:43.516504 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1278/2536] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:29:43.521211 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e5fa9-69e6-4d42-9dc5-bc7db37a2eea admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:43.532271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e5fa9-69e6-4d42-9dc5-bc7db37a2eea admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:43.538383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c137cd1-8c01-4cd7-be8c-ac01fa0c44e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:43.539084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c137cd1-8c01-4cd7-be8c-ac01fa0c44e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.539409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c137cd1-8c01-4cd7-be8c-ac01fa0c44e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.539676 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c137cd1-8c01-4cd7-be8c-ac01fa0c44e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.540427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c137cd1-8c01-4cd7-be8c-ac01fa0c44e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:43.542039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c137cd1-8c01-4cd7-be8c-ac01fa0c44e2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:43.553268 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1259/2537] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:29:43.557681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040a0d4-7aac-4002-82a4-3e8dc7c1b9b0 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:43.568426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040a0d4-7aac-4002-82a4-3e8dc7c1b9b0 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:43.573563 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5e86a-269b-4a49-97d1-e3467372311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:43.574450 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5e86a-269b-4a49-97d1-e3467372311a admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.574720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5e86a-269b-4a49-97d1-e3467372311a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.574984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5e86a-269b-4a49-97d1-e3467372311a admin admin] PATH_INFO: `/v3/projects/a1700ad15ae3467494fdcc80ffd1a648/users/65a9be47ecd648508ef952ebb42a300a/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.591643 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5e86a-269b-4a49-97d1-e3467372311a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1700ad15ae3467494fdcc80ffd1a648, user_id=65a9be47ecd648508ef952ebb42a300a, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:43.594413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5e86a-269b-4a49-97d1-e3467372311a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:43.609157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1279/2538] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:29:43 2022] PUT /identity/v3/projects/a1700ad15ae3467494fdcc80ffd1a648/users/65a9be47ecd648508ef952ebb42a300a/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:29:43.614907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca33d2-2675-494d-bb56-8e90647d1c01 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.615225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca33d2-2675-494d-bb56-8e90647d1c01 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.615497 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca33d2-2675-494d-bb56-8e90647d1c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.636698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a4ca33d2-2675-494d-bb56-8e90647d1c01 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:43.637932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a4ca33d2-2675-494d-bb56-8e90647d1c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:43.701318 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1260/2539] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:43.712487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5e86a-269b-4a49-97d1-e3467372311a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:43.714331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-72c5e86a-269b-4a49-97d1-e3467372311a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:43.787856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5e86a-269b-4a49-97d1-e3467372311a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:43.792257 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424445cb-ccc9-4d27-b01a-669ef925c13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:43.792919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424445cb-ccc9-4d27-b01a-669ef925c13f service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:43.793198 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424445cb-ccc9-4d27-b01a-669ef925c13f service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:43.793500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424445cb-ccc9-4d27-b01a-669ef925c13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:43.803394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424445cb-ccc9-4d27-b01a-669ef925c13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:43.804946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424445cb-ccc9-4d27-b01a-669ef925c13f service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:43.820267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1280/2540] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:29:44.514395 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5eea0-c4b2-4129-b9b7-f9a502244656 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:44.515031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5eea0-c4b2-4129-b9b7-f9a502244656 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:44.515031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5eea0-c4b2-4129-b9b7-f9a502244656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:44.545863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-bad5eea0-c4b2-4129-b9b7-f9a502244656 None None] MFA Rules not processed for user `65a9be47ecd648508ef952ebb42a300a`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:44.547144 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bad5eea0-c4b2-4129-b9b7-f9a502244656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:44.621783 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1261/2541] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:44.632352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424445cb-ccc9-4d27-b01a-669ef925c13f service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:29:44.635226 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-424445cb-ccc9-4d27-b01a-669ef925c13f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:44.697703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424445cb-ccc9-4d27-b01a-669ef925c13f service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:29:44.702068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e2015-1d86-4e7b-b709-3e1d81b41c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:29:44.702756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2015-1d86-4e7b-b709-3e1d81b41c53 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:44.703035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2015-1d86-4e7b-b709-3e1d81b41c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:44.703310 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2015-1d86-4e7b-b709-3e1d81b41c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:44.713623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e2015-1d86-4e7b-b709-3e1d81b41c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:29:44.715116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e2015-1d86-4e7b-b709-3e1d81b41c53 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:29:44.725379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1281/2542] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:29:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:29:46.287243 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aa4eb-5578-4545-9902-01d090231ba9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:46.287793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aa4eb-5578-4545-9902-01d090231ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:46.287793 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aa4eb-5578-4545-9902-01d090231ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:46.310410 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c99aa4eb-5578-4545-9902-01d090231ba9 None None] MFA Rules not processed for user `65a9be47ecd648508ef952ebb42a300a`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:46.311861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c99aa4eb-5578-4545-9902-01d090231ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:46.321222 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1262/2543] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:29:58.082832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ba653-8b04-40fd-bd9b-f91c3a59b92a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:29:58.083642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ba653-8b04-40fd-bd9b-f91c3a59b92a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:29:58.083642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ba653-8b04-40fd-bd9b-f91c3a59b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:29:58.103754 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-d67ba653-8b04-40fd-bd9b-f91c3a59b92a None None] MFA Rules not processed for user `3cd1ffeab8d74519a9b0d2d202e1cf6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:29:58.104951 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d67ba653-8b04-40fd-bd9b-f91c3a59b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:29:58.172843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1282/2544] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:29:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:30:00.057149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99aa4eb-5578-4545-9902-01d090231ba9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:30:00.071132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99aa4eb-5578-4545-9902-01d090231ba9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:30:00.075217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4d95a-4998-4a1c-90af-5883924ca8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:30:00.075876 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4d95a-4998-4a1c-90af-5883924ca8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:30:00.076156 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4d95a-4998-4a1c-90af-5883924ca8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:30:00.076429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4d95a-4998-4a1c-90af-5883924ca8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:30:00.078363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a0a4d95a-4998-4a1c-90af-5883924ca8b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:30:00.182106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4d95a-4998-4a1c-90af-5883924ca8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:30:00.183572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4d95a-4998-4a1c-90af-5883924ca8b3 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:30:00.195902 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1263/2545] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:30:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:30:02.678385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ba653-8b04-40fd-bd9b-f91c3a59b92a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:30:02.694378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ba653-8b04-40fd-bd9b-f91c3a59b92a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:30:02.699319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e114e4-be5e-4a81-8112-0ae9c1820792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:30:02.700240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e114e4-be5e-4a81-8112-0ae9c1820792 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:30:02.700751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e114e4-be5e-4a81-8112-0ae9c1820792 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:30:02.701170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e114e4-be5e-4a81-8112-0ae9c1820792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:30:02.704496 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-33e114e4-be5e-4a81-8112-0ae9c1820792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:30:02.726982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e114e4-be5e-4a81-8112-0ae9c1820792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:30:02.728460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e114e4-be5e-4a81-8112-0ae9c1820792 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:30:02.750635 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1283/2546] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:30:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:30:06.423964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4d95a-4998-4a1c-90af-5883924ca8b3 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:30:06.426125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a0a4d95a-4998-4a1c-90af-5883924ca8b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:30:06.448327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4d95a-4998-4a1c-90af-5883924ca8b3 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:30:06.456684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee574e-115d-4a0c-af6a-8add4a6745d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:30:06.457392 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee574e-115d-4a0c-af6a-8add4a6745d3 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:30:06.457692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee574e-115d-4a0c-af6a-8add4a6745d3 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:30:06.457964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee574e-115d-4a0c-af6a-8add4a6745d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:30:06.459990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c5ee574e-115d-4a0c-af6a-8add4a6745d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:30:06.474082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee574e-115d-4a0c-af6a-8add4a6745d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:30:06.475776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee574e-115d-4a0c-af6a-8add4a6745d3 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:30:06.487344 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1264/2547] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:30:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:30:39.852405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e114e4-be5e-4a81-8112-0ae9c1820792 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:30:39.866981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e114e4-be5e-4a81-8112-0ae9c1820792 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:30:39.875369 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24774fdd-f26a-4a38-8242-38d3749034ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:30:39.876848 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774fdd-f26a-4a38-8242-38d3749034ba service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:30:39.877313 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774fdd-f26a-4a38-8242-38d3749034ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:30:39.878014 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774fdd-f26a-4a38-8242-38d3749034ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:30:39.880909 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-24774fdd-f26a-4a38-8242-38d3749034ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:30:39.897339 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24774fdd-f26a-4a38-8242-38d3749034ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:30:39.898784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24774fdd-f26a-4a38-8242-38d3749034ba service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:30:39.910898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1284/2548] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:30:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:30:47.010795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee574e-115d-4a0c-af6a-8add4a6745d3 service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:30:47.025647 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee574e-115d-4a0c-af6a-8add4a6745d3 service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:30:47.032120 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98a4a-8a8b-46ce-b23b-1bc68306e703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:30:47.032804 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98a4a-8a8b-46ce-b23b-1bc68306e703 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:30:47.033081 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98a4a-8a8b-46ce-b23b-1bc68306e703 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:30:47.033385 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98a4a-8a8b-46ce-b23b-1bc68306e703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:30:47.035402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2ab98a4a-8a8b-46ce-b23b-1bc68306e703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:30:47.049115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab98a4a-8a8b-46ce-b23b-1bc68306e703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:30:47.050889 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab98a4a-8a8b-46ce-b23b-1bc68306e703 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:30:47.062143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1265/2549] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:30:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:30:55.483222 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8060e7-55ed-43ed-a79a-39eb26acde98 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:30:55.483821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8060e7-55ed-43ed-a79a-39eb26acde98 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:30:55.483821 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8060e7-55ed-43ed-a79a-39eb26acde98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:30:55.502545 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ed8060e7-55ed-43ed-a79a-39eb26acde98 None None] MFA Rules not processed for user `65a9be47ecd648508ef952ebb42a300a`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:30:55.503445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ed8060e7-55ed-43ed-a79a-39eb26acde98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:30:55.510476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1285/2550] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:30:55.769856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98a4a-8a8b-46ce-b23b-1bc68306e703 service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:30:55.779720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98a4a-8a8b-46ce-b23b-1bc68306e703 service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:30:55.784341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9984e5-53c1-4f2f-a72b-13b512567625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:30:55.784957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9984e5-53c1-4f2f-a72b-13b512567625 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:30:55.785264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9984e5-53c1-4f2f-a72b-13b512567625 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:30:55.785539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9984e5-53c1-4f2f-a72b-13b512567625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:30:55.787556 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1b9984e5-53c1-4f2f-a72b-13b512567625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:30:55.797716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9984e5-53c1-4f2f-a72b-13b512567625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:30:55.799130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9984e5-53c1-4f2f-a72b-13b512567625 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:30:55.807629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1266/2551] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:30:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:30:56.127771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8060e7-55ed-43ed-a79a-39eb26acde98 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:30:56.129476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ed8060e7-55ed-43ed-a79a-39eb26acde98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:30:56.215232 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8060e7-55ed-43ed-a79a-39eb26acde98 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:30:56.220738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2097f-472b-4b1e-b1ad-39dab03ec3b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac3e041554a4439bfa91520e52fbd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:30:56.221440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2097f-472b-4b1e-b1ad-39dab03ec3b5 service placement] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:30:56.221716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2097f-472b-4b1e-b1ad-39dab03ec3b5 service placement] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:30:56.221986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2097f-472b-4b1e-b1ad-39dab03ec3b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:30:56.223815 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7bf2097f-472b-4b1e-b1ad-39dab03ec3b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:30:56.235452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2097f-472b-4b1e-b1ad-39dab03ec3b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:30:56.237029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2097f-472b-4b1e-b1ad-39dab03ec3b5 service placement] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:30:56.247014 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1286/2552] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:30:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:31:05.088994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9984e5-53c1-4f2f-a72b-13b512567625 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:31:05.094107 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1b9984e5-53c1-4f2f-a72b-13b512567625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:31:05.126775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9984e5-53c1-4f2f-a72b-13b512567625 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:31:05.143754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6abd-4729-4a2a-925b-4f50bd979f1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:31:05.145634 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6abd-4729-4a2a-925b-4f50bd979f1c service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:31:05.146270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6abd-4729-4a2a-925b-4f50bd979f1c service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:31:05.146695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc6abd-4729-4a2a-925b-4f50bd979f1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:31:05.154236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-25fc6abd-4729-4a2a-925b-4f50bd979f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:31:05.168788 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc6abd-4729-4a2a-925b-4f50bd979f1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:31:05.170896 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc6abd-4729-4a2a-925b-4f50bd979f1c service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:31:05.184785 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1267/2553] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:31:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:31:05.314297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770abea-d6ad-44bd-bcba-b6d165bca112 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:31:05.314785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770abea-d6ad-44bd-bcba-b6d165bca112 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:31:05.314897 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770abea-d6ad-44bd-bcba-b6d165bca112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:31:05.346207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1770abea-d6ad-44bd-bcba-b6d165bca112 None None] MFA Rules not processed for user `6b11396acc67415abb08ddddf5680df8`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:31:05.349806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1770abea-d6ad-44bd-bcba-b6d165bca112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:31:05.418303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1287/2554] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:31:29.471359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6abd-4729-4a2a-925b-4f50bd979f1c service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:31:29.487106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc6abd-4729-4a2a-925b-4f50bd979f1c service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:31:29.494130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d82ed-7b16-475d-a954-aeb4e7e426cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:31:29.494699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d82ed-7b16-475d-a954-aeb4e7e426cb service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:31:29.494977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d82ed-7b16-475d-a954-aeb4e7e426cb service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:31:29.495262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d82ed-7b16-475d-a954-aeb4e7e426cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:31:29.509410 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ea1d82ed-7b16-475d-a954-aeb4e7e426cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:31:29.528411 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d82ed-7b16-475d-a954-aeb4e7e426cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:31:29.531716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d82ed-7b16-475d-a954-aeb4e7e426cb service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:31:29.551079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1268/2555] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:31:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:31:31.603095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4643-c89a-4842-9640-3af23327a98b None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:31:31.603859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4643-c89a-4842-9640-3af23327a98b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:31:31.604077 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4643-c89a-4842-9640-3af23327a98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:31:31.627442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-278b4643-c89a-4842-9640-3af23327a98b None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:31:31.628752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-278b4643-c89a-4842-9640-3af23327a98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:31:31.691845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1288/2556] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:31:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:31:31.752384 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d82ed-7b16-475d-a954-aeb4e7e426cb service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:31:31.753959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ea1d82ed-7b16-475d-a954-aeb4e7e426cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:31:31.853550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d82ed-7b16-475d-a954-aeb4e7e426cb service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:31:31.862847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84765db-f1c5-427b-9ac0-081e1247fc07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:31:31.862847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84765db-f1c5-427b-9ac0-081e1247fc07 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:31:31.862847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84765db-f1c5-427b-9ac0-081e1247fc07 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:31:31.862847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84765db-f1c5-427b-9ac0-081e1247fc07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:31:31.872903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84765db-f1c5-427b-9ac0-081e1247fc07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:31:31.874844 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84765db-f1c5-427b-9ac0-081e1247fc07 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:31:31.884097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1269/2557] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:31:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:31:49.692477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b4643-c89a-4842-9640-3af23327a98b None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:31:49.708392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b4643-c89a-4842-9640-3af23327a98b None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:31:49.713803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731cf9e-3cbe-4d8f-a4da-a36e212fa2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:31:49.714852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731cf9e-3cbe-4d8f-a4da-a36e212fa2ed service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:31:49.715237 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731cf9e-3cbe-4d8f-a4da-a36e212fa2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:31:49.715543 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731cf9e-3cbe-4d8f-a4da-a36e212fa2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:31:49.717629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d731cf9e-3cbe-4d8f-a4da-a36e212fa2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:31:49.730180 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731cf9e-3cbe-4d8f-a4da-a36e212fa2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:31:49.731794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731cf9e-3cbe-4d8f-a4da-a36e212fa2ed service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:31:49.741319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1289/2558] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:31:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:31:52.290189 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6f454-e5ea-4161-85a0-f303d4cb1397 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:31:52.291000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6f454-e5ea-4161-85a0-f303d4cb1397 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:31:52.291000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6f454-e5ea-4161-85a0-f303d4cb1397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:31:52.318082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2fc6f454-e5ea-4161-85a0-f303d4cb1397 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:31:52.320530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2fc6f454-e5ea-4161-85a0-f303d4cb1397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:31:52.331523 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1270/2559] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:31:52.344971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731cf9e-3cbe-4d8f-a4da-a36e212fa2ed service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:31:52.359388 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731cf9e-3cbe-4d8f-a4da-a36e212fa2ed service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:31:52.366329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a7536-31cc-423f-a96a-434ea39227c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:31:52.367341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a7536-31cc-423f-a96a-434ea39227c0 service swift] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:31:52.367796 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a7536-31cc-423f-a96a-434ea39227c0 service swift] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:31:52.368080 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a7536-31cc-423f-a96a-434ea39227c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:31:52.384640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a7536-31cc-423f-a96a-434ea39227c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:31:52.386346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a7536-31cc-423f-a96a-434ea39227c0 service swift] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:31:52.395420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1290/2560] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:31:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:32:01.018593 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6f454-e5ea-4161-85a0-f303d4cb1397 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:01.035093 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6f454-e5ea-4161-85a0-f303d4cb1397 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:01.040077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:01.040947 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:01.041217 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:01.041612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] PATH_INFO: `/v3/users/65a9be47ecd648508ef952ebb42a300a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:01.042844 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a9be47ecd648508ef952ebb42a300a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:01.044782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:01.094066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a9be47ecd648508ef952ebb42a300a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:01.103225 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a9be47ecd648508ef952ebb42a300a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:01.117045 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a9be47ecd648508ef952ebb42a300a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:01.117983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a9be47ecd648508ef952ebb42a300a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:01.128132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-c67cdf2c-4646-4d49-8b40-24cdc500d70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a9be47ecd648508ef952ebb42a300a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:01.134925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1271/2561] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:32:01 2022] DELETE /identity/v3/users/65a9be47ecd648508ef952ebb42a300a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:32:01.314757 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a7536-31cc-423f-a96a-434ea39227c0 service swift] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:01.330582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a7536-31cc-423f-a96a-434ea39227c0 service swift] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:01.401499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:01.402412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:01.402806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:01.403191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] PATH_INFO: `/v3/projects/a1700ad15ae3467494fdcc80ffd1a648` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:01.404513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1700ad15ae3467494fdcc80ffd1a648)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:01.406641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:01.459667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1700ad15ae3467494fdcc80ffd1a648', 'request_id': 'req-21051833-cee8-451c-a7b7-832d31ce024a'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:01.465880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1700ad15ae3467494fdcc80ffd1a648', 'request_id': 'req-21051833-cee8-451c-a7b7-832d31ce024a'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:01.471360 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1700ad15ae3467494fdcc80ffd1a648', 'request_id': 'req-21051833-cee8-451c-a7b7-832d31ce024a'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:01.484925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] The token cache is being invalidate because project a1700ad15ae3467494fdcc80ffd1a648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:32:01.485329 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:01.485852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-21051833-cee8-451c-a7b7-832d31ce024a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:01.487475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1291/2562] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:32:01 2022] DELETE /identity/v3/projects/a1700ad15ae3467494fdcc80ffd1a648 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:32:01.493525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241478-5760-4e24-a359-d3b51a6606ab None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:01.493836 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241478-5760-4e24-a359-d3b51a6606ab None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:01.494129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61241478-5760-4e24-a359-d3b51a6606ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:01.512351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-61241478-5760-4e24-a359-d3b51a6606ab None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:01.513590 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-61241478-5760-4e24-a359-d3b51a6606ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:01.578162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1272/2563] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:32:01.586508 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec910-e129-4257-923b-ec8eb18bebf1 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:01.586793 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec910-e129-4257-923b-ec8eb18bebf1 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:01.587066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec910-e129-4257-923b-ec8eb18bebf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:01.749608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-80dec910-e129-4257-923b-ec8eb18bebf1 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:01.750732 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-80dec910-e129-4257-923b-ec8eb18bebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:01.760477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1292/2564] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:32:01.765618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61241478-5760-4e24-a359-d3b51a6606ab None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:01.777348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61241478-5760-4e24-a359-d3b51a6606ab None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:01.783244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fba7cc-25d9-4dbc-a6a4-1557821e139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:01.783906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba7cc-25d9-4dbc-a6a4-1557821e139d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:01.784187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba7cc-25d9-4dbc-a6a4-1557821e139d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:01.784459 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fba7cc-25d9-4dbc-a6a4-1557821e139d admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:01.785208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fba7cc-25d9-4dbc-a6a4-1557821e139d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:32:01.785561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fba7cc-25d9-4dbc-a6a4-1557821e139d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:01.787367 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fba7cc-25d9-4dbc-a6a4-1557821e139d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:01.803750 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1273/2565] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:32:01.809196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dec910-e129-4257-923b-ec8eb18bebf1 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:01.818979 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dec910-e129-4257-923b-ec8eb18bebf1 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:01.824968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83dfd6-ea50-410d-b57d-f8ff36618218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:01.826952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83dfd6-ea50-410d-b57d-f8ff36618218 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:01.826952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83dfd6-ea50-410d-b57d-f8ff36618218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:01.826952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83dfd6-ea50-410d-b57d-f8ff36618218 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:01.827852 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83dfd6-ea50-410d-b57d-f8ff36618218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:01.829456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83dfd6-ea50-410d-b57d-f8ff36618218 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:01.874188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1293/2566] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:32:01 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:32:01.878748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fba7cc-25d9-4dbc-a6a4-1557821e139d admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:01.889205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fba7cc-25d9-4dbc-a6a4-1557821e139d admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:01.949857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051b363-683a-43d7-82a4-9aeb6dc23c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:01.950533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b363-683a-43d7-82a4-9aeb6dc23c22 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:01.950816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b363-683a-43d7-82a4-9aeb6dc23c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:01.951097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051b363-683a-43d7-82a4-9aeb6dc23c22 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:01.952174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051b363-683a-43d7-82a4-9aeb6dc23c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:01.954132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051b363-683a-43d7-82a4-9aeb6dc23c22 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:01.976965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1274/2567] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:32:01 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:32:01.982126 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83dfd6-ea50-410d-b57d-f8ff36618218 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:01.994692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83dfd6-ea50-410d-b57d-f8ff36618218 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:01.999834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940a93a-0067-4708-acf6-f8d81ae3e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:02.000438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940a93a-0067-4708-acf6-f8d81ae3e176 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:02.000714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940a93a-0067-4708-acf6-f8d81ae3e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:02.000986 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940a93a-0067-4708-acf6-f8d81ae3e176 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:02.001818 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940a93a-0067-4708-acf6-f8d81ae3e176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:02.003408 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940a93a-0067-4708-acf6-f8d81ae3e176 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:02.014432 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1294/2568] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:32:02.020065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051b363-683a-43d7-82a4-9aeb6dc23c22 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:02.031485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051b363-683a-43d7-82a4-9aeb6dc23c22 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:02.037778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3702c49-7249-48e0-a825-09251881758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:02.038460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3702c49-7249-48e0-a825-09251881758a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:02.038741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3702c49-7249-48e0-a825-09251881758a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:02.039015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3702c49-7249-48e0-a825-09251881758a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:02.039761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3702c49-7249-48e0-a825-09251881758a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:02.041399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3702c49-7249-48e0-a825-09251881758a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:02.052284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1275/2569] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:32:02.056550 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940a93a-0067-4708-acf6-f8d81ae3e176 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:02.066844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940a93a-0067-4708-acf6-f8d81ae3e176 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:02.072100 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539ef9c-abfe-499f-ba65-07c452a8db8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:02.072991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539ef9c-abfe-499f-ba65-07c452a8db8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:02.073293 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539ef9c-abfe-499f-ba65-07c452a8db8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:02.073575 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539ef9c-abfe-499f-ba65-07c452a8db8c admin admin] PATH_INFO: `/v3/projects/31d17feb519e4403bf2aaa214029e15d/users/3fc07233c65f433d89d22672dd482d65/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:02.098695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539ef9c-abfe-499f-ba65-07c452a8db8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d17feb519e4403bf2aaa214029e15d, user_id=3fc07233c65f433d89d22672dd482d65, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:02.103507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539ef9c-abfe-499f-ba65-07c452a8db8c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:02.128159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1295/2570] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:32:02 2022] PUT /identity/v3/projects/31d17feb519e4403bf2aaa214029e15d/users/3fc07233c65f433d89d22672dd482d65/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:32:02.140126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a52c-29dc-4c14-a73e-c73cc31692e4 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:02.140401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a52c-29dc-4c14-a73e-c73cc31692e4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:02.140684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a52c-29dc-4c14-a73e-c73cc31692e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:02.169559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d6e5a52c-29dc-4c14-a73e-c73cc31692e4 None None] MFA Rules not processed for user `3fc07233c65f433d89d22672dd482d65`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:02.170786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d6e5a52c-29dc-4c14-a73e-c73cc31692e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:02.256109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1276/2571] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:32:02.266936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539ef9c-abfe-499f-ba65-07c452a8db8c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:02.269946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6539ef9c-abfe-499f-ba65-07c452a8db8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:02.334854 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539ef9c-abfe-499f-ba65-07c452a8db8c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:02.338895 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a2036-3fcb-4cf2-ab38-676e3471ffbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:02.339569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a2036-3fcb-4cf2-ab38-676e3471ffbb service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:02.340629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a2036-3fcb-4cf2-ab38-676e3471ffbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:02.340629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a2036-3fcb-4cf2-ab38-676e3471ffbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:02.351442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a2036-3fcb-4cf2-ab38-676e3471ffbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:02.352904 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a2036-3fcb-4cf2-ab38-676e3471ffbb service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:02.362958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1296/2572] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:32:09.473765 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5a52c-29dc-4c14-a73e-c73cc31692e4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:09.542560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5a52c-29dc-4c14-a73e-c73cc31692e4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:09.547668 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:09.548631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:09.548764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:09.548931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] PATH_INFO: `/v3/users/3fc07233c65f433d89d22672dd482d65` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:09.550810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc07233c65f433d89d22672dd482d65)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:09.552837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:09.610969 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc07233c65f433d89d22672dd482d65'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:09.623200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc07233c65f433d89d22672dd482d65'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:09.638865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc07233c65f433d89d22672dd482d65'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:09.639699 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc07233c65f433d89d22672dd482d65'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:09.648692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc07233c65f433d89d22672dd482d65'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:09.655966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1277/2573] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:32:09 2022] DELETE /identity/v3/users/3fc07233c65f433d89d22672dd482d65 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:32:09.660883 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653c60-c9d7-4ce6-b3c8-e83a7c3c2ade None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:09.661609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653c60-c9d7-4ce6-b3c8-e83a7c3c2ade None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:09.661609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653c60-c9d7-4ce6-b3c8-e83a7c3c2ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:09.679161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b3653c60-c9d7-4ce6-b3c8-e83a7c3c2ade None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:09.680370 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b3653c60-c9d7-4ce6-b3c8-e83a7c3c2ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:09.744116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1297/2574] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:32:09.751198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:09.752681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:09.812834 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b089e4-3abe-4133-8fab-527e0bd3bee0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:09.820317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ce715-59c8-4076-80b3-73c58e8b6ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:09.821266 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ce715-59c8-4076-80b3-73c58e8b6ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:09.821687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ce715-59c8-4076-80b3-73c58e8b6ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:09.822090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ce715-59c8-4076-80b3-73c58e8b6ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:09.836686 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ce715-59c8-4076-80b3-73c58e8b6ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:09.840109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ce715-59c8-4076-80b3-73c58e8b6ae4 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:09.856557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1278/2575] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:32:10.143853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653c60-c9d7-4ce6-b3c8-e83a7c3c2ade None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:10.145752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b3653c60-c9d7-4ce6-b3c8-e83a7c3c2ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:10.166772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653c60-c9d7-4ce6-b3c8-e83a7c3c2ade None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:10.179384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:10.180272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.180546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.180812 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] PATH_INFO: `/v3/projects/31d17feb519e4403bf2aaa214029e15d` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.184889 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d17feb519e4403bf2aaa214029e15d)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:10.187296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:10.247774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d17feb519e4403bf2aaa214029e15d', 'request_id': 'req-f3ac9bbe-39b1-4624-8daa-6780097125d2'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:10.256213 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d17feb519e4403bf2aaa214029e15d', 'request_id': 'req-f3ac9bbe-39b1-4624-8daa-6780097125d2'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:10.263039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d17feb519e4403bf2aaa214029e15d', 'request_id': 'req-f3ac9bbe-39b1-4624-8daa-6780097125d2'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:10.281664 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] The token cache is being invalidate because project 31d17feb519e4403bf2aaa214029e15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:32:10.282136 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:10.283316 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f3ac9bbe-39b1-4624-8daa-6780097125d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:32:10.285873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1298/2576] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:32:10 2022] DELETE /identity/v3/projects/31d17feb519e4403bf2aaa214029e15d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:32:10.293962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a188f-0b1a-40d7-b3a5-5eb04cebf1b2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.294250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a188f-0b1a-40d7-b3a5-5eb04cebf1b2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.294529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a188f-0b1a-40d7-b3a5-5eb04cebf1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.318035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-c34a188f-0b1a-40d7-b3a5-5eb04cebf1b2 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:10.319792 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c34a188f-0b1a-40d7-b3a5-5eb04cebf1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:10.379652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1279/2577] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:32:10.387475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23915196-f349-484e-83fd-eaa932d04360 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.387737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23915196-f349-484e-83fd-eaa932d04360 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.388014 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23915196-f349-484e-83fd-eaa932d04360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.407445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-23915196-f349-484e-83fd-eaa932d04360 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:10.408650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-23915196-f349-484e-83fd-eaa932d04360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:10.416859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1299/2578] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:32:10.421242 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a188f-0b1a-40d7-b3a5-5eb04cebf1b2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:10.432195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a188f-0b1a-40d7-b3a5-5eb04cebf1b2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:10.437340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070bc08-d65c-481a-ab8f-94eef5e50851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:10.438006 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070bc08-d65c-481a-ab8f-94eef5e50851 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.438283 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070bc08-d65c-481a-ab8f-94eef5e50851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.438550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070bc08-d65c-481a-ab8f-94eef5e50851 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.439289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070bc08-d65c-481a-ab8f-94eef5e50851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:32:10.439596 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070bc08-d65c-481a-ab8f-94eef5e50851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:10.441238 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070bc08-d65c-481a-ab8f-94eef5e50851 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:10.454238 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1280/2579] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:32:10.459570 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23915196-f349-484e-83fd-eaa932d04360 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:10.469144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23915196-f349-484e-83fd-eaa932d04360 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:10.474877 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245bdd-ac5e-4241-8349-2a77b0a8b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:10.475641 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245bdd-ac5e-4241-8349-2a77b0a8b5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.476018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245bdd-ac5e-4241-8349-2a77b0a8b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.476375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17245bdd-ac5e-4241-8349-2a77b0a8b5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.477183 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17245bdd-ac5e-4241-8349-2a77b0a8b5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:10.479297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17245bdd-ac5e-4241-8349-2a77b0a8b5f8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:10.505866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1300/2580] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:32:10 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:32:10.510457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070bc08-d65c-481a-ab8f-94eef5e50851 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:10.521054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070bc08-d65c-481a-ab8f-94eef5e50851 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:10.582954 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5801-5a59-41ee-9277-0325ff62ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:10.583702 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5801-5a59-41ee-9277-0325ff62ae21 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.584097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5801-5a59-41ee-9277-0325ff62ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.584494 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5801-5a59-41ee-9277-0325ff62ae21 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.585429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5801-5a59-41ee-9277-0325ff62ae21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:10.587441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5801-5a59-41ee-9277-0325ff62ae21 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:10.609405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1281/2581] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:32:10 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:32:10.614735 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245bdd-ac5e-4241-8349-2a77b0a8b5f8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:10.628544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17245bdd-ac5e-4241-8349-2a77b0a8b5f8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:10.633875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb0bc4-322c-474a-bd19-0badfdd5fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:10.634564 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb0bc4-322c-474a-bd19-0badfdd5fdfb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.634847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb0bc4-322c-474a-bd19-0badfdd5fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.635119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb0bc4-322c-474a-bd19-0badfdd5fdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.635870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb0bc4-322c-474a-bd19-0badfdd5fdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:10.637577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb0bc4-322c-474a-bd19-0badfdd5fdfb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:10.650325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1301/2582] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:32:10.654878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5801-5a59-41ee-9277-0325ff62ae21 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:10.666563 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5801-5a59-41ee-9277-0325ff62ae21 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:10.672044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45c6b2-1369-4805-8661-7e201d7e12cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:10.672876 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45c6b2-1369-4805-8661-7e201d7e12cf admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.673197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45c6b2-1369-4805-8661-7e201d7e12cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.673736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45c6b2-1369-4805-8661-7e201d7e12cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.675053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45c6b2-1369-4805-8661-7e201d7e12cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:10.677064 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45c6b2-1369-4805-8661-7e201d7e12cf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:10.694078 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1282/2583] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:32:10.699149 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb0bc4-322c-474a-bd19-0badfdd5fdfb admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:10.711720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb0bc4-322c-474a-bd19-0badfdd5fdfb admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:10.717309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df2a78-8572-4d40-923c-120688e071df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:10.718265 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df2a78-8572-4d40-923c-120688e071df admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.718585 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df2a78-8572-4d40-923c-120688e071df admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.718932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df2a78-8572-4d40-923c-120688e071df admin admin] PATH_INFO: `/v3/projects/842618ac233949f9bbd304fc37feff56/users/64e0bc6be0d64ad794b70b72e9ac551e/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.736703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df2a78-8572-4d40-923c-120688e071df admin admin] RBAC: Authorizing `identity:create_grant(project_id=842618ac233949f9bbd304fc37feff56, user_id=64e0bc6be0d64ad794b70b72e9ac551e, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:10.740971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df2a78-8572-4d40-923c-120688e071df admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:10.761467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1302/2584] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:32:10 2022] PUT /identity/v3/projects/842618ac233949f9bbd304fc37feff56/users/64e0bc6be0d64ad794b70b72e9ac551e/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:32:10.763742 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103800c-c241-4985-900a-75d3e58d2249 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.764255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103800c-c241-4985-900a-75d3e58d2249 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.764737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103800c-c241-4985-900a-75d3e58d2249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.766794 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eec4d-3c92-47cf-8c6f-13376d8b6cf9 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.767168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eec4d-3c92-47cf-8c6f-13376d8b6cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.767427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eec4d-3c92-47cf-8c6f-13376d8b6cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.792530 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ef4eec4d-3c92-47cf-8c6f-13376d8b6cf9 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:10.794248 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ef4eec4d-3c92-47cf-8c6f-13376d8b6cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:10.794854 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a103800c-c241-4985-900a-75d3e58d2249 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:10.796205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a103800c-c241-4985-900a-75d3e58d2249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:10.871823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1303/2585] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:32:10.876654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1283/2586] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jan 28 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:32:10.882708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eec4d-3c92-47cf-8c6f-13376d8b6cf9 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:10.884342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ef4eec4d-3c92-47cf-8c6f-13376d8b6cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:10.893457 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103800c-c241-4985-900a-75d3e58d2249 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:10.895784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a103800c-c241-4985-900a-75d3e58d2249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:10.969838 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eec4d-3c92-47cf-8c6f-13376d8b6cf9 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:10.972703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103800c-c241-4985-900a-75d3e58d2249 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:10.973514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c57f9d-58bf-4cfa-b741-e03a26736e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:10.974194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c57f9d-58bf-4cfa-b741-e03a26736e73 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.974468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c57f9d-58bf-4cfa-b741-e03a26736e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.974735 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c57f9d-58bf-4cfa-b741-e03a26736e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.980422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497b4bb-4be4-4a1c-a00a-786cb84ba6b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:10.981538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497b4bb-4be4-4a1c-a00a-786cb84ba6b9 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:10.981931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497b4bb-4be4-4a1c-a00a-786cb84ba6b9 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:10.982311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497b4bb-4be4-4a1c-a00a-786cb84ba6b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:10.984323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c57f9d-58bf-4cfa-b741-e03a26736e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:10.985876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c57f9d-58bf-4cfa-b741-e03a26736e73 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:10.994911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497b4bb-4be4-4a1c-a00a-786cb84ba6b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:10.995731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1304/2587] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:32:10.997573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497b4bb-4be4-4a1c-a00a-786cb84ba6b9 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:11.011483 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1284/2588] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:32:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 01:32:15.231840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c34752-984b-4947-a530-5df09b8673ae None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:15.232519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c34752-984b-4947-a530-5df09b8673ae None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:15.232519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c34752-984b-4947-a530-5df09b8673ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:15.269710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-23c34752-984b-4947-a530-5df09b8673ae None None] MFA Rules not processed for user `64e0bc6be0d64ad794b70b72e9ac551e`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:15.271594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-23c34752-984b-4947-a530-5df09b8673ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:15.342457 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1305/2589] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:32:15.347205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497b4bb-4be4-4a1c-a00a-786cb84ba6b9 service swift] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:15.357994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497b4bb-4be4-4a1c-a00a-786cb84ba6b9 service swift] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:15.362800 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b6510-d660-448f-b4c1-b92469d0e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:15.363629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b6510-d660-448f-b4c1-b92469d0e983 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:15.363911 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b6510-d660-448f-b4c1-b92469d0e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:15.364177 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b6510-d660-448f-b4c1-b92469d0e983 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:15.364924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b6510-d660-448f-b4c1-b92469d0e983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:15.366870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b6510-d660-448f-b4c1-b92469d0e983 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:15.394220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1285/2590] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:32:15 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:32:15.398519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c34752-984b-4947-a530-5df09b8673ae None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:15.412527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c34752-984b-4947-a530-5df09b8673ae None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:15.476738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427a0ce-e0fb-4173-ac4b-d77e90c4419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:15.477489 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a0ce-e0fb-4173-ac4b-d77e90c4419d admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:15.477982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a0ce-e0fb-4173-ac4b-d77e90c4419d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:15.477982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427a0ce-e0fb-4173-ac4b-d77e90c4419d admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:15.478696 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427a0ce-e0fb-4173-ac4b-d77e90c4419d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:15.480620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427a0ce-e0fb-4173-ac4b-d77e90c4419d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:15.506974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1306/2591] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:32:15 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:32:15.511041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b6510-d660-448f-b4c1-b92469d0e983 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:15.522361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b6510-d660-448f-b4c1-b92469d0e983 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:15.530493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429513e-777f-4103-8809-de1edc4bd2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:15.531235 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429513e-777f-4103-8809-de1edc4bd2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:15.531656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429513e-777f-4103-8809-de1edc4bd2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:15.532026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429513e-777f-4103-8809-de1edc4bd2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:15.532859 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429513e-777f-4103-8809-de1edc4bd2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:15.534838 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429513e-777f-4103-8809-de1edc4bd2ab admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:15.546731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1286/2592] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:32:15.551334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427a0ce-e0fb-4173-ac4b-d77e90c4419d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:15.563840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427a0ce-e0fb-4173-ac4b-d77e90c4419d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:15.569663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb205a-6300-4bbc-9c35-95d815a97262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:15.571430 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb205a-6300-4bbc-9c35-95d815a97262 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:15.571971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb205a-6300-4bbc-9c35-95d815a97262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:15.571971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb205a-6300-4bbc-9c35-95d815a97262 admin admin] PATH_INFO: `/v3/projects/e126f8a879814d7eb33b84bd2cac482f/users/ed7398acbd86474999c7b3212a42c502/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:15.595094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb205a-6300-4bbc-9c35-95d815a97262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e126f8a879814d7eb33b84bd2cac482f, user_id=ed7398acbd86474999c7b3212a42c502, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:15.598479 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb205a-6300-4bbc-9c35-95d815a97262 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:15.618984 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1307/2593] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:32:15 2022] PUT /identity/v3/projects/e126f8a879814d7eb33b84bd2cac482f/users/ed7398acbd86474999c7b3212a42c502/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:32:15.620238 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429513e-777f-4103-8809-de1edc4bd2ab admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:15.634797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429513e-777f-4103-8809-de1edc4bd2ab admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:15.713472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71800047-9376-4702-a7cb-b1902735e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:15.714719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71800047-9376-4702-a7cb-b1902735e3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:15.714906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71800047-9376-4702-a7cb-b1902735e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:15.715079 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71800047-9376-4702-a7cb-b1902735e3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:15.715890 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71800047-9376-4702-a7cb-b1902735e3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:15.717719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71800047-9376-4702-a7cb-b1902735e3d7 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:15.730054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1287/2594] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:32:15.734344 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb205a-6300-4bbc-9c35-95d815a97262 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:15.746663 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb205a-6300-4bbc-9c35-95d815a97262 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:15.752305 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f0336-5046-40c1-9e70-55e95b9bd30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:15.753270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f0336-5046-40c1-9e70-55e95b9bd30c admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:15.753552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f0336-5046-40c1-9e70-55e95b9bd30c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:15.753855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f0336-5046-40c1-9e70-55e95b9bd30c admin admin] PATH_INFO: `/v3/projects/e126f8a879814d7eb33b84bd2cac482f/users/ed7398acbd86474999c7b3212a42c502/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:15.756101 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f0336-5046-40c1-9e70-55e95b9bd30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e126f8a879814d7eb33b84bd2cac482f, user_id=ed7398acbd86474999c7b3212a42c502, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:15.758882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f0336-5046-40c1-9e70-55e95b9bd30c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:15.770320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1308/2595] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:32:15 2022] PUT /identity/v3/projects/e126f8a879814d7eb33b84bd2cac482f/users/ed7398acbd86474999c7b3212a42c502/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:32:20.995965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbb158-ff4b-443e-96e5-d9fdb3d6bbb5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:20.996532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbb158-ff4b-443e-96e5-d9fdb3d6bbb5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:20.996532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbb158-ff4b-443e-96e5-d9fdb3d6bbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:21.027427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-64cbb158-ff4b-443e-96e5-d9fdb3d6bbb5 None None] MFA Rules not processed for user `ed7398acbd86474999c7b3212a42c502`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:21.028996 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-64cbb158-ff4b-443e-96e5-d9fdb3d6bbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:21.107880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1288/2596] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:32:21.119220 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f0336-5046-40c1-9e70-55e95b9bd30c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:32:21.122577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-149f0336-5046-40c1-9e70-55e95b9bd30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:21.204981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f0336-5046-40c1-9e70-55e95b9bd30c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:32:21.210952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da3517-32b1-4c80-96a2-061d87a1cdf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:32:21.211774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3517-32b1-4c80-96a2-061d87a1cdf7 service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:21.212102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3517-32b1-4c80-96a2-061d87a1cdf7 service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:21.212447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da3517-32b1-4c80-96a2-061d87a1cdf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:21.297948 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da3517-32b1-4c80-96a2-061d87a1cdf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:32:21.299893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da3517-32b1-4c80-96a2-061d87a1cdf7 service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:32:21.314824 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1309/2597] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:32:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:32:22.901832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a8355-53ca-49a6-8f78-0bc1290b867b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:22.902468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a8355-53ca-49a6-8f78-0bc1290b867b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:22.902468 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a8355-53ca-49a6-8f78-0bc1290b867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:22.922159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-629a8355-53ca-49a6-8f78-0bc1290b867b None None] MFA Rules not processed for user `64e0bc6be0d64ad794b70b72e9ac551e`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:22.923432 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-629a8355-53ca-49a6-8f78-0bc1290b867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:22.931891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1289/2598] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:32:40.451773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f0ef-cf5b-4a04-bda8-8bdc85930cd4 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:32:40.452296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f0ef-cf5b-4a04-bda8-8bdc85930cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:32:40.452296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f0ef-cf5b-4a04-bda8-8bdc85930cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:32:40.472988 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-7698f0ef-cf5b-4a04-bda8-8bdc85930cd4 None None] MFA Rules not processed for user `f02cd9096152479da885ead20d3ec061`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:32:40.474597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7698f0ef-cf5b-4a04-bda8-8bdc85930cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:32:40.549282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1310/2599] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:33:01.695815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a8355-53ca-49a6-8f78-0bc1290b867b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:01.750303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a8355-53ca-49a6-8f78-0bc1290b867b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:01.754537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2a210-2c96-46ab-b478-37374a349d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:01.755196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2a210-2c96-46ab-b478-37374a349d20 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:01.755473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2a210-2c96-46ab-b478-37374a349d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:01.755743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2a210-2c96-46ab-b478-37374a349d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:01.766112 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2a210-2c96-46ab-b478-37374a349d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:01.767551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2a210-2c96-46ab-b478-37374a349d20 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:01.777297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1290/2600] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:33:02.098729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f0ef-cf5b-4a04-bda8-8bdc85930cd4 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:02.100221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7698f0ef-cf5b-4a04-bda8-8bdc85930cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:02.113426 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698f0ef-cf5b-4a04-bda8-8bdc85930cd4 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:02.117355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b12bac-fc02-4e85-9685-a03ecbd052a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:02.118002 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b12bac-fc02-4e85-9685-a03ecbd052a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:02.118253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b12bac-fc02-4e85-9685-a03ecbd052a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:02.118551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b12bac-fc02-4e85-9685-a03ecbd052a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:02.120476 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a6b12bac-fc02-4e85-9685-a03ecbd052a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:02.183786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b12bac-fc02-4e85-9685-a03ecbd052a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:02.185500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b12bac-fc02-4e85-9685-a03ecbd052a6 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:02.195454 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1311/2601] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:33:06.125510 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2a210-2c96-46ab-b478-37374a349d20 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:06.127484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-14f2a210-2c96-46ab-b478-37374a349d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:06.141666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2a210-2c96-46ab-b478-37374a349d20 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:06.146520 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:06.147394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:06.147664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:06.147934 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] PATH_INFO: `/v3/users/3cd1ffeab8d74519a9b0d2d202e1cf6e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:06.149146 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd1ffeab8d74519a9b0d2d202e1cf6e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:06.151063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:06.198555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd1ffeab8d74519a9b0d2d202e1cf6e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:06.207284 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd1ffeab8d74519a9b0d2d202e1cf6e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:06.221216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd1ffeab8d74519a9b0d2d202e1cf6e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:06.221951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd1ffeab8d74519a9b0d2d202e1cf6e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:06.230110 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-d1fbd97e-6e2d-4f32-b5e7-65c019c5b536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd1ffeab8d74519a9b0d2d202e1cf6e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:06.237333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1291/2602] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:33:06 2022] DELETE /identity/v3/users/3cd1ffeab8d74519a9b0d2d202e1cf6e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:06.416355 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b12bac-fc02-4e85-9685-a03ecbd052a6 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:06.426897 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b12bac-fc02-4e85-9685-a03ecbd052a6 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:06.499490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:06.502272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:06.502919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:06.503451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] PATH_INFO: `/v3/projects/33608c07529f42299cd9ae077624ebdc` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:06.505086 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33608c07529f42299cd9ae077624ebdc)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:06.508466 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:06.562711 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33608c07529f42299cd9ae077624ebdc', 'request_id': 'req-20b0bc78-0101-4ec7-8b53-a6524333dd85'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:06.578975 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33608c07529f42299cd9ae077624ebdc', 'request_id': 'req-20b0bc78-0101-4ec7-8b53-a6524333dd85'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:06.587496 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33608c07529f42299cd9ae077624ebdc', 'request_id': 'req-20b0bc78-0101-4ec7-8b53-a6524333dd85'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:06.602234 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] The token cache is being invalidate because project 33608c07529f42299cd9ae077624ebdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:33:06.602872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:06.604583 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-20b0bc78-0101-4ec7-8b53-a6524333dd85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:06.607277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1312/2603] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:33:06 2022] DELETE /identity/v3/projects/33608c07529f42299cd9ae077624ebdc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:06.613675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf60a3-2710-411e-9ebe-045eab4e7adf None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:06.613965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf60a3-2710-411e-9ebe-045eab4e7adf None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:06.614332 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf60a3-2710-411e-9ebe-045eab4e7adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:06.635072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-2cbf60a3-2710-411e-9ebe-045eab4e7adf None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:06.635072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2cbf60a3-2710-411e-9ebe-045eab4e7adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:06.693685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1292/2604] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:06.704469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28c0a6-600e-47a7-aa6f-db0f3d89e4e2 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:06.704801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28c0a6-600e-47a7-aa6f-db0f3d89e4e2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:06.705021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28c0a6-600e-47a7-aa6f-db0f3d89e4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:06.728082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4a28c0a6-600e-47a7-aa6f-db0f3d89e4e2 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:06.729635 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4a28c0a6-600e-47a7-aa6f-db0f3d89e4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:06.740589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1313/2605] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:33:06.745485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf60a3-2710-411e-9ebe-045eab4e7adf None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:06.755832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf60a3-2710-411e-9ebe-045eab4e7adf None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:06.760816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7e514-e6c0-4536-b8e8-29aaec4ff588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:06.761573 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7e514-e6c0-4536-b8e8-29aaec4ff588 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:06.761844 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7e514-e6c0-4536-b8e8-29aaec4ff588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:06.762111 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7e514-e6c0-4536-b8e8-29aaec4ff588 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:06.762841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7e514-e6c0-4536-b8e8-29aaec4ff588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:33:06.763140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7e514-e6c0-4536-b8e8-29aaec4ff588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:06.764716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7e514-e6c0-4536-b8e8-29aaec4ff588 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:06.780016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1293/2606] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:33:06.784673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28c0a6-600e-47a7-aa6f-db0f3d89e4e2 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:06.794336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28c0a6-600e-47a7-aa6f-db0f3d89e4e2 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:06.799950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce417c-bc16-45da-8d75-5e35ea52ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:06.800633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce417c-bc16-45da-8d75-5e35ea52ad9c admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:06.801841 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce417c-bc16-45da-8d75-5e35ea52ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:06.801841 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce417c-bc16-45da-8d75-5e35ea52ad9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:06.803582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce417c-bc16-45da-8d75-5e35ea52ad9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:06.805741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce417c-bc16-45da-8d75-5e35ea52ad9c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:06.849275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1314/2607] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:33:06 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:33:06.852945 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7e514-e6c0-4536-b8e8-29aaec4ff588 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:06.864960 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7e514-e6c0-4536-b8e8-29aaec4ff588 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:06.939221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b10e58-0b99-4580-83ef-60c641521674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:06.940002 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b10e58-0b99-4580-83ef-60c641521674 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:06.940335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b10e58-0b99-4580-83ef-60c641521674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:06.940764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b10e58-0b99-4580-83ef-60c641521674 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:06.943233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b10e58-0b99-4580-83ef-60c641521674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:06.944645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b10e58-0b99-4580-83ef-60c641521674 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:06.974772 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1294/2608] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:33:06 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:33:06.980244 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce417c-bc16-45da-8d75-5e35ea52ad9c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:06.991054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce417c-bc16-45da-8d75-5e35ea52ad9c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:06.996372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d69c62-d5c7-44c3-a4df-d7e3c6f69c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:06.997048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d69c62-d5c7-44c3-a4df-d7e3c6f69c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:06.997362 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d69c62-d5c7-44c3-a4df-d7e3c6f69c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:06.997706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d69c62-d5c7-44c3-a4df-d7e3c6f69c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:06.998523 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d69c62-d5c7-44c3-a4df-d7e3c6f69c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:07.000146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d69c62-d5c7-44c3-a4df-d7e3c6f69c9b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:07.012823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1315/2609] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:07.018455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b10e58-0b99-4580-83ef-60c641521674 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:07.029883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b10e58-0b99-4580-83ef-60c641521674 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:07.035683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433dd337-7b9a-4978-82c7-955cfe27d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:07.036959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd337-7b9a-4978-82c7-955cfe27d744 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.037390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd337-7b9a-4978-82c7-955cfe27d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.037685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433dd337-7b9a-4978-82c7-955cfe27d744 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.038263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dd337-7b9a-4978-82c7-955cfe27d744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:07.040185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433dd337-7b9a-4978-82c7-955cfe27d744 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:07.053814 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1295/2610] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:07.058427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d69c62-d5c7-44c3-a4df-d7e3c6f69c9b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:07.072864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d69c62-d5c7-44c3-a4df-d7e3c6f69c9b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:07.078196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1663d8-bbf1-42f7-878a-20b33d28015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:07.079178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1663d8-bbf1-42f7-878a-20b33d28015c admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.079521 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1663d8-bbf1-42f7-878a-20b33d28015c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.079851 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1663d8-bbf1-42f7-878a-20b33d28015c admin admin] PATH_INFO: `/v3/projects/1e7240cbe1e947899d2698f067e030a0/users/f6e184984cd444cf85982176cd58768a/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.097215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1663d8-bbf1-42f7-878a-20b33d28015c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7240cbe1e947899d2698f067e030a0, user_id=f6e184984cd444cf85982176cd58768a, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:07.100283 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1663d8-bbf1-42f7-878a-20b33d28015c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:07.116118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1316/2611] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:33:07 2022] PUT /identity/v3/projects/1e7240cbe1e947899d2698f067e030a0/users/f6e184984cd444cf85982176cd58768a/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:07.130320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeddbe-2559-4dbc-bcdb-cde998a7963c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.130982 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeddbe-2559-4dbc-bcdb-cde998a7963c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.131733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeddbe-2559-4dbc-bcdb-cde998a7963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.162870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-fcaeddbe-2559-4dbc-bcdb-cde998a7963c None None] MFA Rules not processed for user `f6e184984cd444cf85982176cd58768a`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:07.164089 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-fcaeddbe-2559-4dbc-bcdb-cde998a7963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:07.249927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1296/2612] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:07.254763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1663d8-bbf1-42f7-878a-20b33d28015c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:07.327170 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1663d8-bbf1-42f7-878a-20b33d28015c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:07.332559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3510e-e64d-4b2e-8025-18c984d1f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:07.333242 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3510e-e64d-4b2e-8025-18c984d1f3ea admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.333545 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3510e-e64d-4b2e-8025-18c984d1f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.333823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3510e-e64d-4b2e-8025-18c984d1f3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.334557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3510e-e64d-4b2e-8025-18c984d1f3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:07.336501 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3510e-e64d-4b2e-8025-18c984d1f3ea admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:07.370376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1317/2613] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:33:07 2022] POST /identity/v3/projects => generated 401 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:33:07.374810 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeddbe-2559-4dbc-bcdb-cde998a7963c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:07.386687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeddbe-2559-4dbc-bcdb-cde998a7963c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:07.459231 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8da867-2ae9-4554-9055-7fa37779c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:07.459909 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da867-2ae9-4554-9055-7fa37779c022 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.460184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da867-2ae9-4554-9055-7fa37779c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.460452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8da867-2ae9-4554-9055-7fa37779c022 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.461163 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8da867-2ae9-4554-9055-7fa37779c022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:07.463090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8da867-2ae9-4554-9055-7fa37779c022 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:07.486986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1297/2614] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:33:07 2022] POST /identity/v3/users => generated 307 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:33:07.494477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3510e-e64d-4b2e-8025-18c984d1f3ea admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:07.507787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3510e-e64d-4b2e-8025-18c984d1f3ea admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:07.515191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a1715-2848-4540-b86a-6b464233b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:07.515915 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1715-2848-4540-b86a-6b464233b574 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.516351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1715-2848-4540-b86a-6b464233b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.516773 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1715-2848-4540-b86a-6b464233b574 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.518108 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a1715-2848-4540-b86a-6b464233b574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:07.520223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a1715-2848-4540-b86a-6b464233b574 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:07.532136 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1318/2615] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:07.536576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8da867-2ae9-4554-9055-7fa37779c022 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:07.547661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8da867-2ae9-4554-9055-7fa37779c022 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:07.554423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae217c0c-a249-461b-930a-cef33e1d0d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:07.555330 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217c0c-a249-461b-930a-cef33e1d0d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.555597 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217c0c-a249-461b-930a-cef33e1d0d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.555863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217c0c-a249-461b-930a-cef33e1d0d7e admin admin] PATH_INFO: `/v3/projects/f0f716dc735543189623a83fab05e866/users/257d0d39ac884370887e02efcfa32af3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.575101 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae217c0c-a249-461b-930a-cef33e1d0d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f716dc735543189623a83fab05e866, user_id=257d0d39ac884370887e02efcfa32af3, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:07.578175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae217c0c-a249-461b-930a-cef33e1d0d7e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:07.605751 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1298/2616] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:33:07 2022] PUT /identity/v3/projects/f0f716dc735543189623a83fab05e866/users/257d0d39ac884370887e02efcfa32af3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:07.609889 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a1715-2848-4540-b86a-6b464233b574 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:07.622571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a1715-2848-4540-b86a-6b464233b574 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:07.699251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4957b0-4bf7-40fd-86c6-736457c74d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:07.699928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4957b0-4bf7-40fd-86c6-736457c74d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.701354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4957b0-4bf7-40fd-86c6-736457c74d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.701354 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4957b0-4bf7-40fd-86c6-736457c74d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.701751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4957b0-4bf7-40fd-86c6-736457c74d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:07.703508 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4957b0-4bf7-40fd-86c6-736457c74d0f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:07.713707 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1319/2617] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:07.718155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae217c0c-a249-461b-930a-cef33e1d0d7e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:07.728466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae217c0c-a249-461b-930a-cef33e1d0d7e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:07.733550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5767df-0bda-41a5-b4db-e0288b63d8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:07.734426 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5767df-0bda-41a5-b4db-e0288b63d8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.734725 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5767df-0bda-41a5-b4db-e0288b63d8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.734999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5767df-0bda-41a5-b4db-e0288b63d8e9 admin admin] PATH_INFO: `/v3/projects/f0f716dc735543189623a83fab05e866/users/257d0d39ac884370887e02efcfa32af3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.736957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5767df-0bda-41a5-b4db-e0288b63d8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f716dc735543189623a83fab05e866, user_id=257d0d39ac884370887e02efcfa32af3, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:07.739738 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5767df-0bda-41a5-b4db-e0288b63d8e9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:07.750496 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1299/2618] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:33:07 2022] PUT /identity/v3/projects/f0f716dc735543189623a83fab05e866/users/257d0d39ac884370887e02efcfa32af3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:33:07.760785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe087f-f21a-48c9-bcb0-c5f6d2e7524c None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.761072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe087f-f21a-48c9-bcb0-c5f6d2e7524c None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.761381 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe087f-f21a-48c9-bcb0-c5f6d2e7524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.787593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1cfe087f-f21a-48c9-bcb0-c5f6d2e7524c None None] MFA Rules not processed for user `257d0d39ac884370887e02efcfa32af3`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:07.788791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1cfe087f-f21a-48c9-bcb0-c5f6d2e7524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:07.859059 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1320/2619] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:07.870445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5767df-0bda-41a5-b4db-e0288b63d8e9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:07.872239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1a5767df-0bda-41a5-b4db-e0288b63d8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:07.943129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5767df-0bda-41a5-b4db-e0288b63d8e9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:07.947499 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3cc26-8518-448c-8996-0647551c45e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:07.948150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3cc26-8518-448c-8996-0647551c45e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:07.948433 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3cc26-8518-448c-8996-0647551c45e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:07.948705 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3cc26-8518-448c-8996-0647551c45e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:07.960305 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3cc26-8518-448c-8996-0647551c45e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:07.962190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3cc26-8518-448c-8996-0647551c45e8 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:07.974481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1300/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:33:08.063795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe087f-f21a-48c9-bcb0-c5f6d2e7524c None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:08.077481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe087f-f21a-48c9-bcb0-c5f6d2e7524c None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:08.082113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1c2fd-b3f1-4ea0-825e-044908fe6abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:08.082843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1c2fd-b3f1-4ea0-825e-044908fe6abb service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:08.083196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1c2fd-b3f1-4ea0-825e-044908fe6abb service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:08.083477 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1c2fd-b3f1-4ea0-825e-044908fe6abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:08.143425 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1c2fd-b3f1-4ea0-825e-044908fe6abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:08.144827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1c2fd-b3f1-4ea0-825e-044908fe6abb service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:08.155448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1321/2621] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:33:12.212799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3cc26-8518-448c-8996-0647551c45e8 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:12.278057 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3cc26-8518-448c-8996-0647551c45e8 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:12.283097 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:12.283995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:12.284275 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:12.284550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] PATH_INFO: `/v3/users/f6e184984cd444cf85982176cd58768a` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:12.285995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e184984cd444cf85982176cd58768a)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:12.287922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:12.339686 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e184984cd444cf85982176cd58768a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:12.346423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e184984cd444cf85982176cd58768a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:12.360990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e184984cd444cf85982176cd58768a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:12.362087 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e184984cd444cf85982176cd58768a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:12.371247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e184984cd444cf85982176cd58768a'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:12.378848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1301/2622] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:33:12 2022] DELETE /identity/v3/users/f6e184984cd444cf85982176cd58768a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:12.383960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadbfe7-00ef-4c7e-8ea8-6322f4d7efa3 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:12.384596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadbfe7-00ef-4c7e-8ea8-6322f4d7efa3 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:12.384785 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadbfe7-00ef-4c7e-8ea8-6322f4d7efa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:12.402471 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-8aadbfe7-00ef-4c7e-8ea8-6322f4d7efa3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:12.403688 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8aadbfe7-00ef-4c7e-8ea8-6322f4d7efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:12.471742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1322/2623] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:12.481912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:12.483631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:12.547474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32757d37-f5c9-480d-b242-b1da3dbf0c9e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:12.552346 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c7d7e-0960-4679-820d-91d340aa09c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:12.553512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c7d7e-0960-4679-820d-91d340aa09c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:12.554107 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c7d7e-0960-4679-820d-91d340aa09c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:12.554491 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c7d7e-0960-4679-820d-91d340aa09c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:12.564997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c7d7e-0960-4679-820d-91d340aa09c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:12.566602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c7d7e-0960-4679-820d-91d340aa09c9 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:12.580399 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1302/2624] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:33:12.872765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadbfe7-00ef-4c7e-8ea8-6322f4d7efa3 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:12.874396 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8aadbfe7-00ef-4c7e-8ea8-6322f4d7efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:12.888286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadbfe7-00ef-4c7e-8ea8-6322f4d7efa3 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:12.893882 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:12.894781 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:12.895055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:12.895322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] PATH_INFO: `/v3/projects/1e7240cbe1e947899d2698f067e030a0` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:12.896703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7240cbe1e947899d2698f067e030a0)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:12.898660 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:12.951437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7240cbe1e947899d2698f067e030a0', 'request_id': 'req-f393195c-a5d0-41d8-b1d2-dddb18db3f59'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:12.958516 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7240cbe1e947899d2698f067e030a0', 'request_id': 'req-f393195c-a5d0-41d8-b1d2-dddb18db3f59'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:12.964487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7240cbe1e947899d2698f067e030a0', 'request_id': 'req-f393195c-a5d0-41d8-b1d2-dddb18db3f59'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:12.978494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] The token cache is being invalidate because project 1e7240cbe1e947899d2698f067e030a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:33:12.978779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:12.979481 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:12.981058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1323/2625] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:33:12 2022] DELETE /identity/v3/projects/1e7240cbe1e947899d2698f067e030a0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:33:12.985939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c7d7e-0960-4679-820d-91d340aa09c9 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:12.996262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c7d7e-0960-4679-820d-91d340aa09c9 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:13.056125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:13.057004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:13.057306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:13.057622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] PATH_INFO: `/v3/users/257d0d39ac884370887e02efcfa32af3` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:13.058875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=257d0d39ac884370887e02efcfa32af3)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:13.060797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:13.112446 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257d0d39ac884370887e02efcfa32af3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:13.123739 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257d0d39ac884370887e02efcfa32af3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:13.137691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257d0d39ac884370887e02efcfa32af3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:13.138447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257d0d39ac884370887e02efcfa32af3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:13.146681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-805eaae7-99e2-4310-a31c-2e9a516092dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257d0d39ac884370887e02efcfa32af3'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:13.154168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1303/2626] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:33:12 2022] DELETE /identity/v3/users/257d0d39ac884370887e02efcfa32af3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:33:13.455778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:13.457289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:13.471652 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393195c-a5d0-41d8-b1d2-dddb18db3f59 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:13.541839 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:13.542761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:13.543037 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:13.543302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] PATH_INFO: `/v3/projects/f0f716dc735543189623a83fab05e866` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:13.544539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f716dc735543189623a83fab05e866)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:13.546483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:13.602648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f716dc735543189623a83fab05e866', 'request_id': 'req-e040402e-ef6b-47a5-93cc-84557e60d2f0'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:13.613211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f716dc735543189623a83fab05e866', 'request_id': 'req-e040402e-ef6b-47a5-93cc-84557e60d2f0'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:13.621018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f716dc735543189623a83fab05e866', 'request_id': 'req-e040402e-ef6b-47a5-93cc-84557e60d2f0'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:13.635483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] The token cache is being invalidate because project f0f716dc735543189623a83fab05e866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:33:13.635797 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:13.636434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e040402e-ef6b-47a5-93cc-84557e60d2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:13.638377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1324/2627] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:33:13 2022] DELETE /identity/v3/projects/f0f716dc735543189623a83fab05e866 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:33:13.646004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b886b7-8692-45fb-a622-284323e0a46b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:13.646563 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b886b7-8692-45fb-a622-284323e0a46b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:13.646687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b886b7-8692-45fb-a622-284323e0a46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:13.667740 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-79b886b7-8692-45fb-a622-284323e0a46b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:13.669071 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-79b886b7-8692-45fb-a622-284323e0a46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:13.735074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1304/2628] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:13.743861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32736-d25c-4686-9a0a-8d76d8e242ef None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:13.744306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32736-d25c-4686-9a0a-8d76d8e242ef None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:13.744600 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32736-d25c-4686-9a0a-8d76d8e242ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:13.769662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e3b32736-d25c-4686-9a0a-8d76d8e242ef None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:13.771130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e3b32736-d25c-4686-9a0a-8d76d8e242ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:13.780751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1325/2629] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:13.785617 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b886b7-8692-45fb-a622-284323e0a46b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:13.795862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b886b7-8692-45fb-a622-284323e0a46b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:13.802136 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532501f4-5a8e-4113-8c45-b9c9a45c69f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:13.802779 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532501f4-5a8e-4113-8c45-b9c9a45c69f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:13.803068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532501f4-5a8e-4113-8c45-b9c9a45c69f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:13.803343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532501f4-5a8e-4113-8c45-b9c9a45c69f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:13.804083 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532501f4-5a8e-4113-8c45-b9c9a45c69f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:33:13.804386 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532501f4-5a8e-4113-8c45-b9c9a45c69f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:13.806129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532501f4-5a8e-4113-8c45-b9c9a45c69f9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:13.818391 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1305/2630] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:33:13.823003 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32736-d25c-4686-9a0a-8d76d8e242ef None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:13.832903 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32736-d25c-4686-9a0a-8d76d8e242ef None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:13.838004 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d61ae-7226-416c-9444-8adce709866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:13.838659 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d61ae-7226-416c-9444-8adce709866b admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:13.838932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d61ae-7226-416c-9444-8adce709866b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:13.839199 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d61ae-7226-416c-9444-8adce709866b admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:13.839893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d61ae-7226-416c-9444-8adce709866b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:13.841822 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d61ae-7226-416c-9444-8adce709866b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:13.867881 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1326/2631] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:33:13 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:33:13.872212 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532501f4-5a8e-4113-8c45-b9c9a45c69f9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:13.883427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532501f4-5a8e-4113-8c45-b9c9a45c69f9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:13.956677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e890605-2c3e-48e4-877e-2dd32ca99725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:13.957420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e890605-2c3e-48e4-877e-2dd32ca99725 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:13.957906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e890605-2c3e-48e4-877e-2dd32ca99725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:13.957906 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e890605-2c3e-48e4-877e-2dd32ca99725 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:13.958658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e890605-2c3e-48e4-877e-2dd32ca99725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:13.960587 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e890605-2c3e-48e4-877e-2dd32ca99725 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:13.984892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1306/2632] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:33:13 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:33:13.989322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d61ae-7226-416c-9444-8adce709866b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:14.002983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d61ae-7226-416c-9444-8adce709866b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:14.008366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bcf25-cea5-496b-ba91-f2d7f272ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:14.009067 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bcf25-cea5-496b-ba91-f2d7f272ce5a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.009384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bcf25-cea5-496b-ba91-f2d7f272ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.009656 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bcf25-cea5-496b-ba91-f2d7f272ce5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.010456 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bcf25-cea5-496b-ba91-f2d7f272ce5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:14.012129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bcf25-cea5-496b-ba91-f2d7f272ce5a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:14.024603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1327/2633] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:14.030056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e890605-2c3e-48e4-877e-2dd32ca99725 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:14.041000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e890605-2c3e-48e4-877e-2dd32ca99725 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:14.046543 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07b35c-ba33-42f1-93dc-7cbad3b9acee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:14.047208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b35c-ba33-42f1-93dc-7cbad3b9acee admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.047539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b35c-ba33-42f1-93dc-7cbad3b9acee admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.047805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07b35c-ba33-42f1-93dc-7cbad3b9acee admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.048544 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07b35c-ba33-42f1-93dc-7cbad3b9acee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:14.050173 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07b35c-ba33-42f1-93dc-7cbad3b9acee admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:14.060905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1307/2634] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:14.066708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bcf25-cea5-496b-ba91-f2d7f272ce5a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:14.079587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bcf25-cea5-496b-ba91-f2d7f272ce5a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:14.085282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b0755-84f1-400d-8070-15b4954ad412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:14.086376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b0755-84f1-400d-8070-15b4954ad412 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.086681 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b0755-84f1-400d-8070-15b4954ad412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.086948 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b0755-84f1-400d-8070-15b4954ad412 admin admin] PATH_INFO: `/v3/projects/9b2abc9bdadc47e9a157fcaf95eab999/users/3bf0408b2aff4e4bb628a80cb15a3cda/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.102063 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b0755-84f1-400d-8070-15b4954ad412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2abc9bdadc47e9a157fcaf95eab999, user_id=3bf0408b2aff4e4bb628a80cb15a3cda, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:14.104671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b0755-84f1-400d-8070-15b4954ad412 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:14.120051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1328/2635] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:33:14 2022] PUT /identity/v3/projects/9b2abc9bdadc47e9a157fcaf95eab999/users/3bf0408b2aff4e4bb628a80cb15a3cda/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:14.131714 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3ac2-a478-4394-9013-510d201de4b8 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.132020 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3ac2-a478-4394-9013-510d201de4b8 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.132293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c3ac2-a478-4394-9013-510d201de4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.170489 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ad1c3ac2-a478-4394-9013-510d201de4b8 None None] MFA Rules not processed for user `3bf0408b2aff4e4bb628a80cb15a3cda`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:14.172570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ad1c3ac2-a478-4394-9013-510d201de4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:14.244302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1308/2636] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:14.249582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b0755-84f1-400d-8070-15b4954ad412 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:14.324351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b0755-84f1-400d-8070-15b4954ad412 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:14.330141 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a355c1-384c-429d-9311-4b8d0da6c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:14.330895 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a355c1-384c-429d-9311-4b8d0da6c381 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.331177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a355c1-384c-429d-9311-4b8d0da6c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.331451 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a355c1-384c-429d-9311-4b8d0da6c381 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.332166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a355c1-384c-429d-9311-4b8d0da6c381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:14.334112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a355c1-384c-429d-9311-4b8d0da6c381 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:14.362597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1329/2637] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:33:14 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:33:14.366871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3ac2-a478-4394-9013-510d201de4b8 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:14.377652 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c3ac2-a478-4394-9013-510d201de4b8 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:14.433932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2f6b9-79f1-4a9c-a04f-253e89b9bfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:14.434600 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2f6b9-79f1-4a9c-a04f-253e89b9bfdf admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.434875 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2f6b9-79f1-4a9c-a04f-253e89b9bfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.435174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2f6b9-79f1-4a9c-a04f-253e89b9bfdf admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.435872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2f6b9-79f1-4a9c-a04f-253e89b9bfdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:14.439674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2f6b9-79f1-4a9c-a04f-253e89b9bfdf admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:14.464181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1309/2638] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:33:14 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:33:14.468760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a355c1-384c-429d-9311-4b8d0da6c381 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:14.480142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a355c1-384c-429d-9311-4b8d0da6c381 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:14.484887 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2c131-6e6d-48d4-984c-067187345fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:14.485613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2c131-6e6d-48d4-984c-067187345fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.485892 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2c131-6e6d-48d4-984c-067187345fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.486879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2c131-6e6d-48d4-984c-067187345fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.486879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2c131-6e6d-48d4-984c-067187345fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:14.489324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2c131-6e6d-48d4-984c-067187345fcc admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:14.503182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1330/2639] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:14.508044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2f6b9-79f1-4a9c-a04f-253e89b9bfdf admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:14.520067 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2f6b9-79f1-4a9c-a04f-253e89b9bfdf admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:14.525847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e92abc-eda6-446b-9dcb-744d03e34110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:14.526799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e92abc-eda6-446b-9dcb-744d03e34110 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.527115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e92abc-eda6-446b-9dcb-744d03e34110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.527440 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e92abc-eda6-446b-9dcb-744d03e34110 admin admin] PATH_INFO: `/v3/projects/8601054153e64a2187f219d48d6db9a2/users/03036c71037d4b95a9cc6cce36ddfed5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.544077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e92abc-eda6-446b-9dcb-744d03e34110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8601054153e64a2187f219d48d6db9a2, user_id=03036c71037d4b95a9cc6cce36ddfed5, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:14.546823 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e92abc-eda6-446b-9dcb-744d03e34110 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:14.565431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1310/2640] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:33:14 2022] PUT /identity/v3/projects/8601054153e64a2187f219d48d6db9a2/users/03036c71037d4b95a9cc6cce36ddfed5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:14.572846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2c131-6e6d-48d4-984c-067187345fcc admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:14.587469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2c131-6e6d-48d4-984c-067187345fcc admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:14.659433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225a115-ff60-4255-902a-c639fc59d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:14.660098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225a115-ff60-4255-902a-c639fc59d82c admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.660372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225a115-ff60-4255-902a-c639fc59d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.660638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225a115-ff60-4255-902a-c639fc59d82c admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.661414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225a115-ff60-4255-902a-c639fc59d82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:14.662997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225a115-ff60-4255-902a-c639fc59d82c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:14.672575 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1331/2641] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:14.677148 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e92abc-eda6-446b-9dcb-744d03e34110 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:14.687663 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e92abc-eda6-446b-9dcb-744d03e34110 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:14.692917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929ac76-46e1-4a3b-b44e-bd9bae66c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:14.693862 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929ac76-46e1-4a3b-b44e-bd9bae66c2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.694137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929ac76-46e1-4a3b-b44e-bd9bae66c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.694402 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929ac76-46e1-4a3b-b44e-bd9bae66c2a4 admin admin] PATH_INFO: `/v3/projects/8601054153e64a2187f219d48d6db9a2/users/03036c71037d4b95a9cc6cce36ddfed5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.697850 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929ac76-46e1-4a3b-b44e-bd9bae66c2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8601054153e64a2187f219d48d6db9a2, user_id=03036c71037d4b95a9cc6cce36ddfed5, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:14.701039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929ac76-46e1-4a3b-b44e-bd9bae66c2a4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:14.712714 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1311/2642] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:33:14 2022] PUT /identity/v3/projects/8601054153e64a2187f219d48d6db9a2/users/03036c71037d4b95a9cc6cce36ddfed5/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:14.722968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d320d0-d57c-4dc8-946c-8c55b7fd51af None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.723238 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d320d0-d57c-4dc8-946c-8c55b7fd51af None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.723516 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d320d0-d57c-4dc8-946c-8c55b7fd51af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.765485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-66d320d0-d57c-4dc8-946c-8c55b7fd51af None None] MFA Rules not processed for user `03036c71037d4b95a9cc6cce36ddfed5`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:14.766607 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-66d320d0-d57c-4dc8-946c-8c55b7fd51af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:14.851601 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1332/2643] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:33:14.862169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929ac76-46e1-4a3b-b44e-bd9bae66c2a4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:14.865871 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1929ac76-46e1-4a3b-b44e-bd9bae66c2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:14.927235 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929ac76-46e1-4a3b-b44e-bd9bae66c2a4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:14.930321 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65aaee-c37a-4238-bf35-536d3cbf3649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:14.930974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65aaee-c37a-4238-bf35-536d3cbf3649 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:14.931253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65aaee-c37a-4238-bf35-536d3cbf3649 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:14.931526 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65aaee-c37a-4238-bf35-536d3cbf3649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:14.943790 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65aaee-c37a-4238-bf35-536d3cbf3649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:14.945685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65aaee-c37a-4238-bf35-536d3cbf3649 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:14.955557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1312/2644] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:33:15.093861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d320d0-d57c-4dc8-946c-8c55b7fd51af None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:15.157954 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d320d0-d57c-4dc8-946c-8c55b7fd51af None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:15.163787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:15.164718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:15.164989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:15.165278 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] PATH_INFO: `/v3/users/3bf0408b2aff4e4bb628a80cb15a3cda` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:15.166890 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf0408b2aff4e4bb628a80cb15a3cda)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:15.170379 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:15.218444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf0408b2aff4e4bb628a80cb15a3cda'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:15.225535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf0408b2aff4e4bb628a80cb15a3cda'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:15.226220 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf0408b2aff4e4bb628a80cb15a3cda'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:15.235695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf0408b2aff4e4bb628a80cb15a3cda'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:15.247765 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf0408b2aff4e4bb628a80cb15a3cda'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:15.253787 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1333/2645] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:33:15 2022] DELETE /identity/v3/users/3bf0408b2aff4e4bb628a80cb15a3cda => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:33:15.258555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3cde9-ed38-491e-ba4a-cd92797062f2 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:15.258842 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3cde9-ed38-491e-ba4a-cd92797062f2 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:15.259164 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3cde9-ed38-491e-ba4a-cd92797062f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:15.278711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-04e3cde9-ed38-491e-ba4a-cd92797062f2 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:15.279873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-04e3cde9-ed38-491e-ba4a-cd92797062f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:15.355341 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1313/2646] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:15.365537 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:15.367046 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:15.430938 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ae68d-94ef-4c83-ac76-284f14cc7202 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:15.434724 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcd5a7-f784-40a9-bc94-642fa82df927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:15.435392 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcd5a7-f784-40a9-bc94-642fa82df927 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:15.435684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcd5a7-f784-40a9-bc94-642fa82df927 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:15.435948 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcd5a7-f784-40a9-bc94-642fa82df927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:15.446790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcd5a7-f784-40a9-bc94-642fa82df927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:15.448222 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcd5a7-f784-40a9-bc94-642fa82df927 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:15.461577 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1334/2647] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:33:15.745484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3cde9-ed38-491e-ba4a-cd92797062f2 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:15.747016 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-04e3cde9-ed38-491e-ba4a-cd92797062f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:15.761258 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3cde9-ed38-491e-ba4a-cd92797062f2 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:15.767216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:15.768096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:15.768419 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:15.768690 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] PATH_INFO: `/v3/projects/9b2abc9bdadc47e9a157fcaf95eab999` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:15.770143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2abc9bdadc47e9a157fcaf95eab999)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:15.772618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:15.824831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2abc9bdadc47e9a157fcaf95eab999', 'request_id': 'req-2f9fed6d-76f2-4e33-8b58-0175524d6868'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:15.834708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2abc9bdadc47e9a157fcaf95eab999', 'request_id': 'req-2f9fed6d-76f2-4e33-8b58-0175524d6868'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:15.841548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2abc9bdadc47e9a157fcaf95eab999', 'request_id': 'req-2f9fed6d-76f2-4e33-8b58-0175524d6868'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:15.853171 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] The token cache is being invalidate because project 9b2abc9bdadc47e9a157fcaf95eab999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:33:15.853560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:15.854245 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:15.855841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1314/2648] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:33:15 2022] DELETE /identity/v3/projects/9b2abc9bdadc47e9a157fcaf95eab999 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:15.860055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcd5a7-f784-40a9-bc94-642fa82df927 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:15.870676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcd5a7-f784-40a9-bc94-642fa82df927 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:15.945012 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:15.946500 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:15.946970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:15.947395 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] PATH_INFO: `/v3/users/03036c71037d4b95a9cc6cce36ddfed5` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:15.949053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03036c71037d4b95a9cc6cce36ddfed5)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:15.951414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:16.006672 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03036c71037d4b95a9cc6cce36ddfed5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:16.014190 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03036c71037d4b95a9cc6cce36ddfed5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:16.014994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03036c71037d4b95a9cc6cce36ddfed5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:16.024030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03036c71037d4b95a9cc6cce36ddfed5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:16.036623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-1e8508bf-333b-4d09-a56b-8ed0f2673314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03036c71037d4b95a9cc6cce36ddfed5'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:16.042589 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1335/2649] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:33:15 2022] DELETE /identity/v3/users/03036c71037d4b95a9cc6cce36ddfed5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:16.323843 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:16.325681 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:16.340813 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fed6d-76f2-4e33-8b58-0175524d6868 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:16.404817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:16.405737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:16.406011 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:16.406276 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] PATH_INFO: `/v3/projects/8601054153e64a2187f219d48d6db9a2` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:16.407552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8601054153e64a2187f219d48d6db9a2)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:16.409595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:16.459977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8601054153e64a2187f219d48d6db9a2', 'request_id': 'req-cc7c1634-c860-496a-b719-82e92d82801b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:16.468745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8601054153e64a2187f219d48d6db9a2', 'request_id': 'req-cc7c1634-c860-496a-b719-82e92d82801b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:16.477027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8601054153e64a2187f219d48d6db9a2', 'request_id': 'req-cc7c1634-c860-496a-b719-82e92d82801b'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:16.490706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] The token cache is being invalidate because project 8601054153e64a2187f219d48d6db9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:33:16.490706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:16.491727 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-cc7c1634-c860-496a-b719-82e92d82801b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:16.493690 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1315/2650] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:33:16 2022] DELETE /identity/v3/projects/8601054153e64a2187f219d48d6db9a2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:16.501925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac17fd-907e-416a-ad78-8165f99e5c43 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:16.502394 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac17fd-907e-416a-ad78-8165f99e5c43 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:16.502958 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac17fd-907e-416a-ad78-8165f99e5c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:16.525378 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-0dac17fd-907e-416a-ad78-8165f99e5c43 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:16.526593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0dac17fd-907e-416a-ad78-8165f99e5c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:16.585293 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1336/2651] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:16.594503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045fc72-8e9e-4d45-a353-91dd703a0609 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:16.594812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045fc72-8e9e-4d45-a353-91dd703a0609 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:16.595085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045fc72-8e9e-4d45-a353-91dd703a0609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:16.614487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-1045fc72-8e9e-4d45-a353-91dd703a0609 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:16.615706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-1045fc72-8e9e-4d45-a353-91dd703a0609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:16.624162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1316/2652] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:33:16.628716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac17fd-907e-416a-ad78-8165f99e5c43 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:16.645160 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac17fd-907e-416a-ad78-8165f99e5c43 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:16.650826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da100b98-6675-4c8f-a853-8cb129773d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:16.650826 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da100b98-6675-4c8f-a853-8cb129773d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:16.651616 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da100b98-6675-4c8f-a853-8cb129773d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:16.651805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da100b98-6675-4c8f-a853-8cb129773d4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:16.652547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da100b98-6675-4c8f-a853-8cb129773d4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:33:16.652844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da100b98-6675-4c8f-a853-8cb129773d4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:16.654488 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da100b98-6675-4c8f-a853-8cb129773d4e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:16.667266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1337/2653] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:33:16.671618 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045fc72-8e9e-4d45-a353-91dd703a0609 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:16.681216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045fc72-8e9e-4d45-a353-91dd703a0609 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:16.690528 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710e7a6-e933-4576-b4bc-db47130ef2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:16.691201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710e7a6-e933-4576-b4bc-db47130ef2eb admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:16.691486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710e7a6-e933-4576-b4bc-db47130ef2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:16.691741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710e7a6-e933-4576-b4bc-db47130ef2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:16.692456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710e7a6-e933-4576-b4bc-db47130ef2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:16.694622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710e7a6-e933-4576-b4bc-db47130ef2eb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:16.723684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1317/2654] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:33:16 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:33:16.728347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da100b98-6675-4c8f-a853-8cb129773d4e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:16.738465 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da100b98-6675-4c8f-a853-8cb129773d4e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:16.794264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c5fc9-a640-42f5-b01a-763bf180bfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:16.794939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c5fc9-a640-42f5-b01a-763bf180bfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:16.795220 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c5fc9-a640-42f5-b01a-763bf180bfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:16.795494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c5fc9-a640-42f5-b01a-763bf180bfb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:16.796211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c5fc9-a640-42f5-b01a-763bf180bfb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:16.798161 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c5fc9-a640-42f5-b01a-763bf180bfb2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:16.818104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1338/2655] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:33:16 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:33:16.822636 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710e7a6-e933-4576-b4bc-db47130ef2eb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:16.835185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710e7a6-e933-4576-b4bc-db47130ef2eb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:16.840551 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ca059-eb93-47cf-af68-6c3968c24c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:16.841239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca059-eb93-47cf-af68-6c3968c24c24 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:16.841530 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca059-eb93-47cf-af68-6c3968c24c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:16.841801 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca059-eb93-47cf-af68-6c3968c24c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:16.842542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ca059-eb93-47cf-af68-6c3968c24c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:16.844141 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1ca059-eb93-47cf-af68-6c3968c24c24 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:16.855294 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1318/2656] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:16.861778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c5fc9-a640-42f5-b01a-763bf180bfb2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:16.872866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c5fc9-a640-42f5-b01a-763bf180bfb2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:16.878551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84add7-e7b5-4c34-b9ac-e298b375ee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:16.879533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84add7-e7b5-4c34-b9ac-e298b375ee93 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:16.879889 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84add7-e7b5-4c34-b9ac-e298b375ee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:16.880188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84add7-e7b5-4c34-b9ac-e298b375ee93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:16.880940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84add7-e7b5-4c34-b9ac-e298b375ee93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:16.882580 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84add7-e7b5-4c34-b9ac-e298b375ee93 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:16.892898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1339/2657] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:16.897379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ca059-eb93-47cf-af68-6c3968c24c24 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:16.909884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ca059-eb93-47cf-af68-6c3968c24c24 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:16.915377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c060084-53da-41b9-ac92-596c54ae2527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:16.916264 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c060084-53da-41b9-ac92-596c54ae2527 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:16.916539 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c060084-53da-41b9-ac92-596c54ae2527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:16.916805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c060084-53da-41b9-ac92-596c54ae2527 admin admin] PATH_INFO: `/v3/projects/b8380bef1c444256b635400397afc224/users/c1a95b2aa5174ce4a463e069c00f9aa4/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:16.933252 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c060084-53da-41b9-ac92-596c54ae2527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8380bef1c444256b635400397afc224, user_id=c1a95b2aa5174ce4a463e069c00f9aa4, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:16.935857 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c060084-53da-41b9-ac92-596c54ae2527 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:16.965404 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1319/2658] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:33:16 2022] PUT /identity/v3/projects/b8380bef1c444256b635400397afc224/users/c1a95b2aa5174ce4a463e069c00f9aa4/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:33:16.968823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15446d7-e974-4faf-8a09-46e3b4ae5115 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:16.969118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15446d7-e974-4faf-8a09-46e3b4ae5115 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:16.969487 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15446d7-e974-4faf-8a09-46e3b4ae5115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:16.999579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b15446d7-e974-4faf-8a09-46e3b4ae5115 None None] MFA Rules not processed for user `c1a95b2aa5174ce4a463e069c00f9aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:17.000820 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b15446d7-e974-4faf-8a09-46e3b4ae5115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:17.076346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1340/2659] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:17.087628 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c060084-53da-41b9-ac92-596c54ae2527 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:17.089518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7c060084-53da-41b9-ac92-596c54ae2527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:17.175582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c060084-53da-41b9-ac92-596c54ae2527 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:17.179562 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe091a7-e964-4150-8516-51b4168b1678 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec2950259d4ed0925d7a19a6217af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:17.180208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe091a7-e964-4150-8516-51b4168b1678 service glance] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:17.180484 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe091a7-e964-4150-8516-51b4168b1678 service glance] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:17.180755 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe091a7-e964-4150-8516-51b4168b1678 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:17.189308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe091a7-e964-4150-8516-51b4168b1678 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:17.190708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe091a7-e964-4150-8516-51b4168b1678 service glance] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:17.199554 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1320/2660] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:33:33.316908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15446d7-e974-4faf-8a09-46e3b4ae5115 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:33.318447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b15446d7-e974-4faf-8a09-46e3b4ae5115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:33.386493 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15446d7-e974-4faf-8a09-46e3b4ae5115 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:33.391314 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51607d0d-dd65-46a6-8f93-8615bc361830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:33.391982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51607d0d-dd65-46a6-8f93-8615bc361830 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:33.392323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51607d0d-dd65-46a6-8f93-8615bc361830 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:33.392599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51607d0d-dd65-46a6-8f93-8615bc361830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:33.394782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-51607d0d-dd65-46a6-8f93-8615bc361830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:33.480277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51607d0d-dd65-46a6-8f93-8615bc361830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:33.481571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51607d0d-dd65-46a6-8f93-8615bc361830 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:33.497393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1341/2661] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:33:39.104253 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe091a7-e964-4150-8516-51b4168b1678 service glance] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:39.183615 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe091a7-e964-4150-8516-51b4168b1678 service glance] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:39.188798 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:39.189825 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:39.190041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:39.190316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] PATH_INFO: `/v3/users/c1a95b2aa5174ce4a463e069c00f9aa4` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:39.191569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a95b2aa5174ce4a463e069c00f9aa4)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:39.193824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:39.269995 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a95b2aa5174ce4a463e069c00f9aa4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:39.279707 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a95b2aa5174ce4a463e069c00f9aa4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:39.299424 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a95b2aa5174ce4a463e069c00f9aa4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:39.300456 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a95b2aa5174ce4a463e069c00f9aa4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:39.312581 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a95b2aa5174ce4a463e069c00f9aa4'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:39.319973 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1321/2662] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:33:39 2022] DELETE /identity/v3/users/c1a95b2aa5174ce4a463e069c00f9aa4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:39.325444 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b128a-6b71-43bf-840c-3e197c8dd4b3 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:39.326031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b128a-6b71-43bf-840c-3e197c8dd4b3 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:39.326031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b128a-6b71-43bf-840c-3e197c8dd4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:39.349122 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1b1b128a-6b71-43bf-840c-3e197c8dd4b3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:39.350590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1b1b128a-6b71-43bf-840c-3e197c8dd4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:39.424887 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1342/2663] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:39.437665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:39.439291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:39.507643 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc079d-62ae-44b5-ad4f-46fcf8ef9cf4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:39.511899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac49d2-415b-4722-b42a-e2902f0e6359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:39.512568 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac49d2-415b-4722-b42a-e2902f0e6359 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:39.512847 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac49d2-415b-4722-b42a-e2902f0e6359 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:39.513121 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac49d2-415b-4722-b42a-e2902f0e6359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:39.523571 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac49d2-415b-4722-b42a-e2902f0e6359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:39.525163 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac49d2-415b-4722-b42a-e2902f0e6359 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:39.535734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1322/2664] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:33:39.870093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b128a-6b71-43bf-840c-3e197c8dd4b3 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:39.871835 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1b1b128a-6b71-43bf-840c-3e197c8dd4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:39.896627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b128a-6b71-43bf-840c-3e197c8dd4b3 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:39.902850 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:39.903843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:39.904065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:39.904718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] PATH_INFO: `/v3/projects/b8380bef1c444256b635400397afc224` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:39.906610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8380bef1c444256b635400397afc224)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:39.908970 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:39.968708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8380bef1c444256b635400397afc224', 'request_id': 'req-ec4ea16c-c5c7-4163-b0b0-a06396e38706'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:39.977032 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8380bef1c444256b635400397afc224', 'request_id': 'req-ec4ea16c-c5c7-4163-b0b0-a06396e38706'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:39.987846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8380bef1c444256b635400397afc224', 'request_id': 'req-ec4ea16c-c5c7-4163-b0b0-a06396e38706'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:40.009671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] The token cache is being invalidate because project b8380bef1c444256b635400397afc224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:33:40.009905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:40.010576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-ec4ea16c-c5c7-4163-b0b0-a06396e38706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:33:40.012525 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1343/2665] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:33:39 2022] DELETE /identity/v3/projects/b8380bef1c444256b635400397afc224 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:33:40.019273 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eb8bc-18ad-4072-9fd8-f6d8fb8bb635 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:40.019542 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eb8bc-18ad-4072-9fd8-f6d8fb8bb635 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:40.019850 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eb8bc-18ad-4072-9fd8-f6d8fb8bb635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:40.038967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-251eb8bc-18ad-4072-9fd8-f6d8fb8bb635 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:40.040246 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-251eb8bc-18ad-4072-9fd8-f6d8fb8bb635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:40.125697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1323/2666] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:40.133815 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c66025-152f-4adc-b318-7dde0ab47b14 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:40.134104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c66025-152f-4adc-b318-7dde0ab47b14 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:40.134369 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c66025-152f-4adc-b318-7dde0ab47b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:40.155062 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-96c66025-152f-4adc-b318-7dde0ab47b14 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:40.156287 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-96c66025-152f-4adc-b318-7dde0ab47b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:40.164761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1344/2667] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:40.169614 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eb8bc-18ad-4072-9fd8-f6d8fb8bb635 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:40.181321 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eb8bc-18ad-4072-9fd8-f6d8fb8bb635 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:40.187176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45da0-aaf6-4cbd-8d5b-cfdaff2bcfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:40.188109 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45da0-aaf6-4cbd-8d5b-cfdaff2bcfde admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:40.188338 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45da0-aaf6-4cbd-8d5b-cfdaff2bcfde admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:40.188570 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c45da0-aaf6-4cbd-8d5b-cfdaff2bcfde admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:40.189504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c45da0-aaf6-4cbd-8d5b-cfdaff2bcfde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:33:40.189692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c45da0-aaf6-4cbd-8d5b-cfdaff2bcfde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:40.191392 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c45da0-aaf6-4cbd-8d5b-cfdaff2bcfde admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:40.205367 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1324/2668] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:33:40.210321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c66025-152f-4adc-b318-7dde0ab47b14 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:40.221926 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c66025-152f-4adc-b318-7dde0ab47b14 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:40.228324 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e4291-d045-4c65-9e70-61a7436aa2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:40.228991 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e4291-d045-4c65-9e70-61a7436aa2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:40.229323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e4291-d045-4c65-9e70-61a7436aa2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:40.229684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e4291-d045-4c65-9e70-61a7436aa2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:40.230448 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e4291-d045-4c65-9e70-61a7436aa2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:40.232416 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e4291-d045-4c65-9e70-61a7436aa2b8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:40.270404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1345/2669] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:33:40 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:33:40.274998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45da0-aaf6-4cbd-8d5b-cfdaff2bcfde admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:40.286464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c45da0-aaf6-4cbd-8d5b-cfdaff2bcfde admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:40.360834 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cb458-f2e6-42f9-abbd-8630853bf127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:40.361557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cb458-f2e6-42f9-abbd-8630853bf127 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:40.361837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cb458-f2e6-42f9-abbd-8630853bf127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:40.362106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cb458-f2e6-42f9-abbd-8630853bf127 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:40.362828 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cb458-f2e6-42f9-abbd-8630853bf127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:40.364784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cb458-f2e6-42f9-abbd-8630853bf127 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:40.396027 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1325/2670] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:33:40 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:33:40.402613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e4291-d045-4c65-9e70-61a7436aa2b8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:40.414467 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e4291-d045-4c65-9e70-61a7436aa2b8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:40.420694 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcc0f-4128-49c3-b028-8c75e97e85fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:40.424748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcc0f-4128-49c3-b028-8c75e97e85fe admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:40.424748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcc0f-4128-49c3-b028-8c75e97e85fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:40.424748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdcc0f-4128-49c3-b028-8c75e97e85fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:40.424748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdcc0f-4128-49c3-b028-8c75e97e85fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:40.424748 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdcc0f-4128-49c3-b028-8c75e97e85fe admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:40.437069 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1346/2671] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:33:40.442610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cb458-f2e6-42f9-abbd-8630853bf127 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:40.456679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cb458-f2e6-42f9-abbd-8630853bf127 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:40.463333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260c6ae-7787-470e-aa1c-e0eea27dd57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:40.464021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260c6ae-7787-470e-aa1c-e0eea27dd57e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:40.465481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260c6ae-7787-470e-aa1c-e0eea27dd57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:40.465481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260c6ae-7787-470e-aa1c-e0eea27dd57e admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:40.465481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260c6ae-7787-470e-aa1c-e0eea27dd57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:40.467021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260c6ae-7787-470e-aa1c-e0eea27dd57e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:40.478315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1326/2672] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:33:40.484106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcc0f-4128-49c3-b028-8c75e97e85fe admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:40.494972 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdcc0f-4128-49c3-b028-8c75e97e85fe admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:40.500742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3468f9d-f5c7-4745-a16b-446972e7ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:40.501741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3468f9d-f5c7-4745-a16b-446972e7ba2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:40.502014 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3468f9d-f5c7-4745-a16b-446972e7ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:40.502289 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3468f9d-f5c7-4745-a16b-446972e7ba2f admin admin] PATH_INFO: `/v3/projects/228f75d4dcc04b3ca2d7e2c443e657d6/users/ca67647ea67f4812b0c10ea52bbfddbc/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:40.519898 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3468f9d-f5c7-4745-a16b-446972e7ba2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=228f75d4dcc04b3ca2d7e2c443e657d6, user_id=ca67647ea67f4812b0c10ea52bbfddbc, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:40.522998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3468f9d-f5c7-4745-a16b-446972e7ba2f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:40.546057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1347/2673] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:33:40 2022] PUT /identity/v3/projects/228f75d4dcc04b3ca2d7e2c443e657d6/users/ca67647ea67f4812b0c10ea52bbfddbc/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:33:40.551529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f32f0f-3cca-4060-9662-cd20b557629f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:40.551812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f32f0f-3cca-4060-9662-cd20b557629f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:40.552123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f32f0f-3cca-4060-9662-cd20b557629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:40.577588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-71f32f0f-3cca-4060-9662-cd20b557629f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:40.578849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-71f32f0f-3cca-4060-9662-cd20b557629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:40.659436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1327/2674] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:40.685710 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3468f9d-f5c7-4745-a16b-446972e7ba2f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:40.687799 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e3468f9d-f5c7-4745-a16b-446972e7ba2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:40.759674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3468f9d-f5c7-4745-a16b-446972e7ba2f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:40.767013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45da280-7e02-41a5-a09e-b583a7a41c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:40.768048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da280-7e02-41a5-a09e-b583a7a41c4a service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:40.768519 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da280-7e02-41a5-a09e-b583a7a41c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:40.768946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da280-7e02-41a5-a09e-b583a7a41c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:40.781359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da280-7e02-41a5-a09e-b583a7a41c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:40.782855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da280-7e02-41a5-a09e-b583a7a41c4a service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:40.795078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1348/2675] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:33:41.443764 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741d03-475a-4d89-8ba4-471b1587bbde None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:41.444291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741d03-475a-4d89-8ba4-471b1587bbde None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:41.444291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741d03-475a-4d89-8ba4-471b1587bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:41.472524 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bb0e0-3702-469a-bb37-acfd0cfed90b None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:41.473582 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bb0e0-3702-469a-bb37-acfd0cfed90b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:41.474053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bb0e0-3702-469a-bb37-acfd0cfed90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:41.474833 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-96741d03-475a-4d89-8ba4-471b1587bbde None None] MFA Rules not processed for user `6b11396acc67415abb08ddddf5680df8`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:41.476072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-96741d03-475a-4d89-8ba4-471b1587bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:41.502338 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-f16bb0e0-3702-469a-bb37-acfd0cfed90b None None] MFA Rules not processed for user `ca67647ea67f4812b0c10ea52bbfddbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:41.503662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f16bb0e0-3702-469a-bb37-acfd0cfed90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:41.531156 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1328/2676] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:41.579507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1349/2677] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:33:41.589988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741d03-475a-4d89-8ba4-471b1587bbde None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:41.591478 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-96741d03-475a-4d89-8ba4-471b1587bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:41.669524 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741d03-475a-4d89-8ba4-471b1587bbde None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:41.673201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c6c39-920b-40b8-8932-58885ba3ab79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:41.673997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c6c39-920b-40b8-8932-58885ba3ab79 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:41.674133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c6c39-920b-40b8-8932-58885ba3ab79 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:41.674401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c6c39-920b-40b8-8932-58885ba3ab79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:41.683753 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c6c39-920b-40b8-8932-58885ba3ab79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:41.685198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c6c39-920b-40b8-8932-58885ba3ab79 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:41.695187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1329/2678] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:33:43.053104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55bb18-4550-4bbf-81ce-21c47cc1e6fa None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:43.053979 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55bb18-4550-4bbf-81ce-21c47cc1e6fa None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:43.053979 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55bb18-4550-4bbf-81ce-21c47cc1e6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:43.073596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-3b55bb18-4550-4bbf-81ce-21c47cc1e6fa None None] MFA Rules not processed for user `ca67647ea67f4812b0c10ea52bbfddbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:33:43.075492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-3b55bb18-4550-4bbf-81ce-21c47cc1e6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:43.083043 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1350/2679] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:33:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:33:43.179149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c6c39-920b-40b8-8932-58885ba3ab79 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:33:43.180631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a08c6c39-920b-40b8-8932-58885ba3ab79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:43.258492 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c6c39-920b-40b8-8932-58885ba3ab79 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:33:43.263619 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4cd03-1ee0-479b-b02b-b29ccd23daf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac3e041554a4439bfa91520e52fbd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:33:43.264358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4cd03-1ee0-479b-b02b-b29ccd23daf7 service placement] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:33:43.264816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4cd03-1ee0-479b-b02b-b29ccd23daf7 service placement] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:33:43.265059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4cd03-1ee0-479b-b02b-b29ccd23daf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:33:43.267354 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8da4cd03-1ee0-479b-b02b-b29ccd23daf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:33:43.279931 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4cd03-1ee0-479b-b02b-b29ccd23daf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:33:43.281592 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4cd03-1ee0-479b-b02b-b29ccd23daf7 service placement] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:33:43.291902 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1330/2680] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:33:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:34:00.071191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb330bf-22b0-43f7-a450-7c1434c4fbc4 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:00.072049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb330bf-22b0-43f7-a450-7c1434c4fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:00.072049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb330bf-22b0-43f7-a450-7c1434c4fbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:00.092645 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-9eb330bf-22b0-43f7-a450-7c1434c4fbc4 None None] MFA Rules not processed for user `ca67647ea67f4812b0c10ea52bbfddbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:00.094305 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9eb330bf-22b0-43f7-a450-7c1434c4fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:00.101644 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1351/2681] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:01.163778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4cd03-1ee0-479b-b02b-b29ccd23daf7 service placement] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:01.165198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8da4cd03-1ee0-479b-b02b-b29ccd23daf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:01.256796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4cd03-1ee0-479b-b02b-b29ccd23daf7 service placement] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:01.263255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdbdac-90a5-4334-a200-9262fb552e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:01.263932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdbdac-90a5-4334-a200-9262fb552e87 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:01.264205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdbdac-90a5-4334-a200-9262fb552e87 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:01.264470 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdbdac-90a5-4334-a200-9262fb552e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:01.266612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-08cdbdac-90a5-4334-a200-9262fb552e87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:01.331704 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdbdac-90a5-4334-a200-9262fb552e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:01.333323 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdbdac-90a5-4334-a200-9262fb552e87 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:01.343553 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1331/2682] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:34:05.629795 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb330bf-22b0-43f7-a450-7c1434c4fbc4 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:05.632474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9eb330bf-22b0-43f7-a450-7c1434c4fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:05.656070 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb330bf-22b0-43f7-a450-7c1434c4fbc4 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:05.660916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba418c24-8316-4342-8fd0-cfa6b8ec8c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:05.661873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba418c24-8316-4342-8fd0-cfa6b8ec8c6d service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:05.662337 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba418c24-8316-4342-8fd0-cfa6b8ec8c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:05.662744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba418c24-8316-4342-8fd0-cfa6b8ec8c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:05.665143 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ba418c24-8316-4342-8fd0-cfa6b8ec8c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:05.762566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba418c24-8316-4342-8fd0-cfa6b8ec8c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:05.764279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba418c24-8316-4342-8fd0-cfa6b8ec8c6d service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:05.775200 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1352/2683] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:34:17.682968 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdbdac-90a5-4334-a200-9262fb552e87 service nova] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:17.693796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdbdac-90a5-4334-a200-9262fb552e87 service nova] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:17.697865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92adfa6-a51b-49ba-8789-bd0e6e8a333e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:17.698622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92adfa6-a51b-49ba-8789-bd0e6e8a333e service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:17.699248 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92adfa6-a51b-49ba-8789-bd0e6e8a333e service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:17.699559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92adfa6-a51b-49ba-8789-bd0e6e8a333e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:17.701905 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-c92adfa6-a51b-49ba-8789-bd0e6e8a333e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:17.717629 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92adfa6-a51b-49ba-8789-bd0e6e8a333e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:17.719214 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92adfa6-a51b-49ba-8789-bd0e6e8a333e service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:17.729922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1332/2684] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:34:21.549739 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba418c24-8316-4342-8fd0-cfa6b8ec8c6d service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:21.552291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ba418c24-8316-4342-8fd0-cfa6b8ec8c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:21.569885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba418c24-8316-4342-8fd0-cfa6b8ec8c6d service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:21.575932 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:21.576825 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:21.577102 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:21.577412 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] PATH_INFO: `/v3/users/f02cd9096152479da885ead20d3ec061` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:21.578813 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f02cd9096152479da885ead20d3ec061)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:21.580864 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:21.637319 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f02cd9096152479da885ead20d3ec061'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:21.644277 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f02cd9096152479da885ead20d3ec061'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:21.644978 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f02cd9096152479da885ead20d3ec061'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:21.653633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f02cd9096152479da885ead20d3ec061'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:21.666967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a5a9e9ce-c401-40e4-bd66-76c387028e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f02cd9096152479da885ead20d3ec061'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:21.675295 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1353/2685] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:34:21 2022] DELETE /identity/v3/users/f02cd9096152479da885ead20d3ec061 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:21.884471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92adfa6-a51b-49ba-8789-bd0e6e8a333e service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:21.895351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92adfa6-a51b-49ba-8789-bd0e6e8a333e service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:21.957702 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:21.958767 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:21.959042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:21.959333 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] PATH_INFO: `/v3/projects/0639b703e727474d8b71d24f7709a813` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:21.960695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0639b703e727474d8b71d24f7709a813)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:21.962645 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:22.020313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0639b703e727474d8b71d24f7709a813', 'request_id': 'req-339ae114-9e2c-4109-aef8-8c23513d445d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:22.031378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0639b703e727474d8b71d24f7709a813', 'request_id': 'req-339ae114-9e2c-4109-aef8-8c23513d445d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:22.039981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0639b703e727474d8b71d24f7709a813', 'request_id': 'req-339ae114-9e2c-4109-aef8-8c23513d445d'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:22.053389 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] The token cache is being invalidate because project 0639b703e727474d8b71d24f7709a813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:34:22.053688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:22.054361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-339ae114-9e2c-4109-aef8-8c23513d445d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:22.055918 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1333/2686] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:34:21 2022] DELETE /identity/v3/projects/0639b703e727474d8b71d24f7709a813 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:22.063020 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7873-cd9c-44c6-97e5-68e1fbfb4475 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.063540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7873-cd9c-44c6-97e5-68e1fbfb4475 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.063973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7873-cd9c-44c6-97e5-68e1fbfb4475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.095182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-eefe7873-cd9c-44c6-97e5-68e1fbfb4475 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:22.096386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-eefe7873-cd9c-44c6-97e5-68e1fbfb4475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:22.105703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b42d-6eb0-4b00-952f-52821179c635 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.106123 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b42d-6eb0-4b00-952f-52821179c635 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.106513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b42d-6eb0-4b00-952f-52821179c635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.125028 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-eeb7b42d-6eb0-4b00-952f-52821179c635 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:22.126256 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-eeb7b42d-6eb0-4b00-952f-52821179c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:22.158190 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1354/2687] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:34:22.166960 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584193d6-0c96-40ad-82ba-c11441332a3e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.167369 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584193d6-0c96-40ad-82ba-c11441332a3e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.167814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584193d6-0c96-40ad-82ba-c11441332a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.185352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1334/2688] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:34:22.188596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-584193d6-0c96-40ad-82ba-c11441332a3e None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:22.189829 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-584193d6-0c96-40ad-82ba-c11441332a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:22.198142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1355/2689] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:34:22.202649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7b42d-6eb0-4b00-952f-52821179c635 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:22.214208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7b42d-6eb0-4b00-952f-52821179c635 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:22.219255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17e5b9-6218-4bf8-acb0-4e4e3ca1f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:22.219917 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17e5b9-6218-4bf8-acb0-4e4e3ca1f0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.220192 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17e5b9-6218-4bf8-acb0-4e4e3ca1f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.220460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17e5b9-6218-4bf8-acb0-4e4e3ca1f0b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.221199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17e5b9-6218-4bf8-acb0-4e4e3ca1f0b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:34:22.221532 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17e5b9-6218-4bf8-acb0-4e4e3ca1f0b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:22.223299 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17e5b9-6218-4bf8-acb0-4e4e3ca1f0b3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:22.241267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1335/2690] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:34:22.241517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584193d6-0c96-40ad-82ba-c11441332a3e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:22.241855 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-584193d6-0c96-40ad-82ba-c11441332a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:22.243113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17e5b9-6218-4bf8-acb0-4e4e3ca1f0b3 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:22.253730 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17e5b9-6218-4bf8-acb0-4e4e3ca1f0b3 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:22.259466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87806db2-7f17-47a1-9c11-26c52534ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:22.260213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87806db2-7f17-47a1-9c11-26c52534ef44 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.260493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87806db2-7f17-47a1-9c11-26c52534ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.260760 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87806db2-7f17-47a1-9c11-26c52534ef44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.261538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87806db2-7f17-47a1-9c11-26c52534ef44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:22.264104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87806db2-7f17-47a1-9c11-26c52534ef44 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:22.296661 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1336/2691] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:34:22 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:34:22.301084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87806db2-7f17-47a1-9c11-26c52534ef44 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:22.317933 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584193d6-0c96-40ad-82ba-c11441332a3e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:22.362938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87806db2-7f17-47a1-9c11-26c52534ef44 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:22.368529 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65935040-f490-4856-9a18-8c2cb89077df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:22.369257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65935040-f490-4856-9a18-8c2cb89077df admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.369554 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65935040-f490-4856-9a18-8c2cb89077df admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.369815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65935040-f490-4856-9a18-8c2cb89077df admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.370537 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65935040-f490-4856-9a18-8c2cb89077df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:22.372656 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65935040-f490-4856-9a18-8c2cb89077df admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:22.375884 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174274c-8434-4514-bb12-6bdb2881d480 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:22.376531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174274c-8434-4514-bb12-6bdb2881d480 service swift] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.376811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174274c-8434-4514-bb12-6bdb2881d480 service swift] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.377084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174274c-8434-4514-bb12-6bdb2881d480 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.395682 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1337/2692] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:34:22 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:34:22.400108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65935040-f490-4856-9a18-8c2cb89077df admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:22.410336 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65935040-f490-4856-9a18-8c2cb89077df admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:22.415692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b09a0a-c700-420c-ad8a-0bc464626c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:22.416418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b09a0a-c700-420c-ad8a-0bc464626c87 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.416697 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b09a0a-c700-420c-ad8a-0bc464626c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.416972 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b09a0a-c700-420c-ad8a-0bc464626c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.417734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b09a0a-c700-420c-ad8a-0bc464626c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:22.419348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b09a0a-c700-420c-ad8a-0bc464626c87 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:22.429791 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1338/2693] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:34:22.434206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b09a0a-c700-420c-ad8a-0bc464626c87 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:22.437478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174274c-8434-4514-bb12-6bdb2881d480 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:22.439091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174274c-8434-4514-bb12-6bdb2881d480 service swift] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:22.444979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b09a0a-c700-420c-ad8a-0bc464626c87 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:22.447433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1356/2694] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:34:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:34:22.451270 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43852222-aceb-41f4-ac3d-1495ebb7d996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:22.452053 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852222-aceb-41f4-ac3d-1495ebb7d996 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.452197 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852222-aceb-41f4-ac3d-1495ebb7d996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.452471 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43852222-aceb-41f4-ac3d-1495ebb7d996 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.453201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43852222-aceb-41f4-ac3d-1495ebb7d996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:22.454908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43852222-aceb-41f4-ac3d-1495ebb7d996 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:22.467846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1339/2695] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:34:22.473575 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174274c-8434-4514-bb12-6bdb2881d480 service swift] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:22.492541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174274c-8434-4514-bb12-6bdb2881d480 service swift] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:22.499834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c96b2-0112-495f-af04-239bfb1739fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:22.501034 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c96b2-0112-495f-af04-239bfb1739fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.501405 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c96b2-0112-495f-af04-239bfb1739fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.501900 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c96b2-0112-495f-af04-239bfb1739fa admin admin] PATH_INFO: `/v3/projects/a396f63ea4df4c61a70eaf4dd0e48718/users/13b899edf0ba43e6bafa7ec6b36a01d6/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.522366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c96b2-0112-495f-af04-239bfb1739fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a396f63ea4df4c61a70eaf4dd0e48718, user_id=13b899edf0ba43e6bafa7ec6b36a01d6, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:22.525472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c96b2-0112-495f-af04-239bfb1739fa admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:22.542490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1357/2696] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:34:22 2022] PUT /identity/v3/projects/a396f63ea4df4c61a70eaf4dd0e48718/users/13b899edf0ba43e6bafa7ec6b36a01d6/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:22.556782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ff90-54be-489e-9b4c-40e5c8b3eab5 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.557376 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ff90-54be-489e-9b4c-40e5c8b3eab5 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.558065 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ff90-54be-489e-9b4c-40e5c8b3eab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.598820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-dab2ff90-54be-489e-9b4c-40e5c8b3eab5 None None] MFA Rules not processed for user `13b899edf0ba43e6bafa7ec6b36a01d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:22.600927 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dab2ff90-54be-489e-9b4c-40e5c8b3eab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:22.689658 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1340/2697] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:22.710633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c96b2-0112-495f-af04-239bfb1739fa admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:22.713830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-0a3c96b2-0112-495f-af04-239bfb1739fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:22.802249 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c96b2-0112-495f-af04-239bfb1739fa admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:22.807899 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d05ae0-abb4-400b-8e29-8e4df7cde64b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:22.808916 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d05ae0-abb4-400b-8e29-8e4df7cde64b service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:22.809447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d05ae0-abb4-400b-8e29-8e4df7cde64b service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:22.809998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d05ae0-abb4-400b-8e29-8e4df7cde64b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:22.830171 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d05ae0-abb4-400b-8e29-8e4df7cde64b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:22.832940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d05ae0-abb4-400b-8e29-8e4df7cde64b service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:22.848885 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1358/2698] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:34:32.358463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ff90-54be-489e-9b4c-40e5c8b3eab5 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:32.439223 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ff90-54be-489e-9b4c-40e5c8b3eab5 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:32.444550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:32.445517 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:32.445770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:32.446041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] PATH_INFO: `/v3/users/13b899edf0ba43e6bafa7ec6b36a01d6` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:32.447387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b899edf0ba43e6bafa7ec6b36a01d6)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:32.449894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:32.524441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b899edf0ba43e6bafa7ec6b36a01d6'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:32.537162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b899edf0ba43e6bafa7ec6b36a01d6'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:32.551043 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b899edf0ba43e6bafa7ec6b36a01d6'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:32.552475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b899edf0ba43e6bafa7ec6b36a01d6'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:32.562167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b899edf0ba43e6bafa7ec6b36a01d6'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:32.569949 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1341/2699] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:34:32 2022] DELETE /identity/v3/users/13b899edf0ba43e6bafa7ec6b36a01d6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:34:32.574584 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0662-5849-4fc9-99ab-3070ea3e3d7a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:32.575157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0662-5849-4fc9-99ab-3070ea3e3d7a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:32.575157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0662-5849-4fc9-99ab-3070ea3e3d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:32.597535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-73dc0662-5849-4fc9-99ab-3070ea3e3d7a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:32.597535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-73dc0662-5849-4fc9-99ab-3070ea3e3d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:32.699744 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1359/2700] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:34:32.716317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:32.718286 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:32.807822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050f29-be75-4abe-9878-d06d09cd4674 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:32.815142 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc508ce8-9d9e-42bb-8aef-c2bba5b7c675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:32.816269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc508ce8-9d9e-42bb-8aef-c2bba5b7c675 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:32.816659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc508ce8-9d9e-42bb-8aef-c2bba5b7c675 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:32.817056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc508ce8-9d9e-42bb-8aef-c2bba5b7c675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:32.829432 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc508ce8-9d9e-42bb-8aef-c2bba5b7c675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:32.830990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc508ce8-9d9e-42bb-8aef-c2bba5b7c675 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:32.842232 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1342/2701] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:34:33.253193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0662-5849-4fc9-99ab-3070ea3e3d7a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:33.257678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-73dc0662-5849-4fc9-99ab-3070ea3e3d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:33.296760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0662-5849-4fc9-99ab-3070ea3e3d7a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:33.305153 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:33.311751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:33.312468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:33.312859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] PATH_INFO: `/v3/projects/a396f63ea4df4c61a70eaf4dd0e48718` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:33.315258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a396f63ea4df4c61a70eaf4dd0e48718)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:33.320478 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:33.402876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a396f63ea4df4c61a70eaf4dd0e48718', 'request_id': 'req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:33.412823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a396f63ea4df4c61a70eaf4dd0e48718', 'request_id': 'req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:33.420422 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a396f63ea4df4c61a70eaf4dd0e48718', 'request_id': 'req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:33.441039 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] The token cache is being invalidate because project a396f63ea4df4c61a70eaf4dd0e48718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:34:33.441381 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:33.442367 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-e8bf2dee-0eae-411b-bd4d-1554fcfb09ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:33.450571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1360/2702] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:34:33 2022] DELETE /identity/v3/projects/a396f63ea4df4c61a70eaf4dd0e48718 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:33.459593 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec3fa-6010-480c-a0d7-961f8d8c3c9f None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:33.460672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec3fa-6010-480c-a0d7-961f8d8c3c9f None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:33.460672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec3fa-6010-480c-a0d7-961f8d8c3c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:33.489908 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-9dcec3fa-6010-480c-a0d7-961f8d8c3c9f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:33.491289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9dcec3fa-6010-480c-a0d7-961f8d8c3c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:33.586610 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1343/2703] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:33.595035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc09c5-c51f-4f71-ae40-fe11d779997a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:33.595633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc09c5-c51f-4f71-ae40-fe11d779997a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:33.596716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc09c5-c51f-4f71-ae40-fe11d779997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:33.643304 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b0dc09c5-c51f-4f71-ae40-fe11d779997a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:33.645028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b0dc09c5-c51f-4f71-ae40-fe11d779997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:33.659630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1361/2704] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:33.665205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcec3fa-6010-480c-a0d7-961f8d8c3c9f None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:33.675864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcec3fa-6010-480c-a0d7-961f8d8c3c9f None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:33.694324 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b4c16-8527-4bfa-92ba-bbbae78dbdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:33.695096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b4c16-8527-4bfa-92ba-bbbae78dbdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:33.695394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b4c16-8527-4bfa-92ba-bbbae78dbdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:33.695678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b4c16-8527-4bfa-92ba-bbbae78dbdb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:33.696504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b4c16-8527-4bfa-92ba-bbbae78dbdb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:34:33.696835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b4c16-8527-4bfa-92ba-bbbae78dbdb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:33.699986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b4c16-8527-4bfa-92ba-bbbae78dbdb0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:33.729873 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1344/2705] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:34:33.737208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc09c5-c51f-4f71-ae40-fe11d779997a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:33.748321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc09c5-c51f-4f71-ae40-fe11d779997a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:33.766352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd540b7b-d1ba-4914-9333-35a1b1819766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:33.769725 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd540b7b-d1ba-4914-9333-35a1b1819766 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:33.771350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd540b7b-d1ba-4914-9333-35a1b1819766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:33.771998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd540b7b-d1ba-4914-9333-35a1b1819766 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:33.774844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd540b7b-d1ba-4914-9333-35a1b1819766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:33.780677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd540b7b-d1ba-4914-9333-35a1b1819766 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:33.839605 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1362/2706] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:34:33 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:34:33.840935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b4c16-8527-4bfa-92ba-bbbae78dbdb0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:33.855533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b4c16-8527-4bfa-92ba-bbbae78dbdb0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:33.950868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1475ff-5610-4035-97b5-16a1556fc9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:33.951828 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1475ff-5610-4035-97b5-16a1556fc9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:33.952198 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1475ff-5610-4035-97b5-16a1556fc9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:33.952572 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1475ff-5610-4035-97b5-16a1556fc9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:33.953473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1475ff-5610-4035-97b5-16a1556fc9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:33.955660 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1475ff-5610-4035-97b5-16a1556fc9c1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:33.993802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1345/2707] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:34:33 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:34:33.996994 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd540b7b-d1ba-4914-9333-35a1b1819766 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:34.011995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd540b7b-d1ba-4914-9333-35a1b1819766 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:34.034254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9527759-141a-497c-94de-dcfc306bab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:34.035298 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9527759-141a-497c-94de-dcfc306bab61 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:34.035658 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9527759-141a-497c-94de-dcfc306bab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:34.036112 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9527759-141a-497c-94de-dcfc306bab61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:34.037071 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9527759-141a-497c-94de-dcfc306bab61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:34.038957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9527759-141a-497c-94de-dcfc306bab61 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:34.053762 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1363/2708] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:34:34.058425 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1475ff-5610-4035-97b5-16a1556fc9c1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:34.082569 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1475ff-5610-4035-97b5-16a1556fc9c1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:34.093586 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034137b6-663a-40a6-af32-03d3e4c0228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:34.095735 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034137b6-663a-40a6-af32-03d3e4c0228a admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:34.096604 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034137b6-663a-40a6-af32-03d3e4c0228a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:34.097650 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034137b6-663a-40a6-af32-03d3e4c0228a admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:34.099547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034137b6-663a-40a6-af32-03d3e4c0228a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:34.103712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034137b6-663a-40a6-af32-03d3e4c0228a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:34.125512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1346/2709] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:34:34.130419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9527759-141a-497c-94de-dcfc306bab61 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:34.146620 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9527759-141a-497c-94de-dcfc306bab61 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:34.154537 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ed8ea-c62c-4ddc-a9d6-0768eb9337fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:34.155999 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ed8ea-c62c-4ddc-a9d6-0768eb9337fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:34.156591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ed8ea-c62c-4ddc-a9d6-0768eb9337fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:34.157032 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ed8ea-c62c-4ddc-a9d6-0768eb9337fe admin admin] PATH_INFO: `/v3/projects/eb78a5a088434f5f9c01a9fcc9e905bf/users/7759395fbbae4fa4a939edb3ae1fb6e9/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:34.181332 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ed8ea-c62c-4ddc-a9d6-0768eb9337fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb78a5a088434f5f9c01a9fcc9e905bf, user_id=7759395fbbae4fa4a939edb3ae1fb6e9, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:34.186209 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ed8ea-c62c-4ddc-a9d6-0768eb9337fe admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:34.206150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1364/2710] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:34:34 2022] PUT /identity/v3/projects/eb78a5a088434f5f9c01a9fcc9e905bf/users/7759395fbbae4fa4a939edb3ae1fb6e9/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:34.228039 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60299b77-e1cb-49a7-bf18-5dc1655319f3 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:34.228560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60299b77-e1cb-49a7-bf18-5dc1655319f3 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:34.229076 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60299b77-e1cb-49a7-bf18-5dc1655319f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:34.287398 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-60299b77-e1cb-49a7-bf18-5dc1655319f3 None None] MFA Rules not processed for user `7759395fbbae4fa4a939edb3ae1fb6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:34.289648 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-60299b77-e1cb-49a7-bf18-5dc1655319f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:34.390500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1347/2711] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:34.395533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ed8ea-c62c-4ddc-a9d6-0768eb9337fe admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:34.494914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ed8ea-c62c-4ddc-a9d6-0768eb9337fe admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:34.504113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba9e16-e036-48b0-8be0-1a072c7ccc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:34.504113 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9e16-e036-48b0-8be0-1a072c7ccc6c admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:34.505299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9e16-e036-48b0-8be0-1a072c7ccc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:34.505299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9e16-e036-48b0-8be0-1a072c7ccc6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:34.507130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba9e16-e036-48b0-8be0-1a072c7ccc6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:34.507796 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba9e16-e036-48b0-8be0-1a072c7ccc6c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:34.542674 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1365/2712] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:34:34 2022] POST /identity/v3/projects => generated 361 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:34:34.548487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60299b77-e1cb-49a7-bf18-5dc1655319f3 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:34.565621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60299b77-e1cb-49a7-bf18-5dc1655319f3 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:34.669106 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409eae-9562-447f-87d2-8aabe27aa8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:34.669952 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409eae-9562-447f-87d2-8aabe27aa8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:34.670234 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409eae-9562-447f-87d2-8aabe27aa8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:34.670602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8409eae-9562-447f-87d2-8aabe27aa8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:34.671337 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8409eae-9562-447f-87d2-8aabe27aa8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:34.674533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8409eae-9562-447f-87d2-8aabe27aa8f9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:34.703695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1348/2713] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:34:34 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:34:34.705936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba9e16-e036-48b0-8be0-1a072c7ccc6c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:34.723619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba9e16-e036-48b0-8be0-1a072c7ccc6c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:34.733532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd6945-4208-4f18-af39-dcc2c141554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:34.735420 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd6945-4208-4f18-af39-dcc2c141554f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:34.736408 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd6945-4208-4f18-af39-dcc2c141554f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:34.737099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd6945-4208-4f18-af39-dcc2c141554f admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:34.738854 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd6945-4208-4f18-af39-dcc2c141554f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:34.742273 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd6945-4208-4f18-af39-dcc2c141554f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:34.766157 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1366/2714] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:34:34.767287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409eae-9562-447f-87d2-8aabe27aa8f9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:34.778344 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8409eae-9562-447f-87d2-8aabe27aa8f9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:34.783048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62c2ea-28af-4dd2-be36-32a316708af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:34.784438 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c2ea-28af-4dd2-be36-32a316708af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:34.784713 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c2ea-28af-4dd2-be36-32a316708af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:34.784983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c2ea-28af-4dd2-be36-32a316708af1 admin admin] PATH_INFO: `/v3/projects/261b9433790a49bdb7385036f85d795e/users/c69b98223f804109b0b3ce551514db26/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:34.804665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62c2ea-28af-4dd2-be36-32a316708af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261b9433790a49bdb7385036f85d795e, user_id=c69b98223f804109b0b3ce551514db26, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:34.808841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62c2ea-28af-4dd2-be36-32a316708af1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:34.832022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1349/2715] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:34:34 2022] PUT /identity/v3/projects/261b9433790a49bdb7385036f85d795e/users/c69b98223f804109b0b3ce551514db26/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:34.837936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd6945-4208-4f18-af39-dcc2c141554f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:34.852026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd6945-4208-4f18-af39-dcc2c141554f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:34.925613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173a803-8f34-49e1-8f4a-146f5e98977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:34.926331 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a803-8f34-49e1-8f4a-146f5e98977f admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:34.926638 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a803-8f34-49e1-8f4a-146f5e98977f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:34.926918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173a803-8f34-49e1-8f4a-146f5e98977f admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:34.927686 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173a803-8f34-49e1-8f4a-146f5e98977f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:34.929756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173a803-8f34-49e1-8f4a-146f5e98977f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:34.945275 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1367/2716] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:34:34.948986 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62c2ea-28af-4dd2-be36-32a316708af1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:34.965826 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62c2ea-28af-4dd2-be36-32a316708af1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:34.970895 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ef76b-77ba-41de-aa34-8087fe701d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:34.972436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ef76b-77ba-41de-aa34-8087fe701d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:34.972743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ef76b-77ba-41de-aa34-8087fe701d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:34.973015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ef76b-77ba-41de-aa34-8087fe701d0a admin admin] PATH_INFO: `/v3/projects/261b9433790a49bdb7385036f85d795e/users/c69b98223f804109b0b3ce551514db26/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:34.976083 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ef76b-77ba-41de-aa34-8087fe701d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=261b9433790a49bdb7385036f85d795e, user_id=c69b98223f804109b0b3ce551514db26, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:34.978703 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ef76b-77ba-41de-aa34-8087fe701d0a admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:34.992831 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1350/2717] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:34:34 2022] PUT /identity/v3/projects/261b9433790a49bdb7385036f85d795e/users/c69b98223f804109b0b3ce551514db26/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:35.009527 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa111f9-ec7b-4f21-9e6e-a2cd1501cb19 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:35.010236 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa111f9-ec7b-4f21-9e6e-a2cd1501cb19 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:35.010520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa111f9-ec7b-4f21-9e6e-a2cd1501cb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:35.054336 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-5aa111f9-ec7b-4f21-9e6e-a2cd1501cb19 None None] MFA Rules not processed for user `c69b98223f804109b0b3ce551514db26`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:35.055854 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5aa111f9-ec7b-4f21-9e6e-a2cd1501cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:35.155632 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1368/2718] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:35.169185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ef76b-77ba-41de-aa34-8087fe701d0a admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:35.172019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dc9ef76b-77ba-41de-aa34-8087fe701d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:35.292029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ef76b-77ba-41de-aa34-8087fe701d0a admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:35.300031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab16cd-9291-421b-8941-fe200c9d7bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:35.301428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab16cd-9291-421b-8941-fe200c9d7bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:35.301683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab16cd-9291-421b-8941-fe200c9d7bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:35.302186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab16cd-9291-421b-8941-fe200c9d7bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:35.320086 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab16cd-9291-421b-8941-fe200c9d7bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:35.323083 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab16cd-9291-421b-8941-fe200c9d7bf0 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:35.345848 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1351/2719] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:35 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:34:35.449925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa111f9-ec7b-4f21-9e6e-a2cd1501cb19 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:35.462747 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa111f9-ec7b-4f21-9e6e-a2cd1501cb19 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:35.468830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c014a-c06f-455d-9f04-62a3b075d9dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:35.470323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c014a-c06f-455d-9f04-62a3b075d9dd service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:35.470930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c014a-c06f-455d-9f04-62a3b075d9dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:35.471555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c014a-c06f-455d-9f04-62a3b075d9dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:35.576595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c014a-c06f-455d-9f04-62a3b075d9dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:35.579036 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c014a-c06f-455d-9f04-62a3b075d9dd service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:35.592578 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1369/2720] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:34:42.994815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e61eb-d6b0-44ca-b939-780e7189adb4 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:42.995317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e61eb-d6b0-44ca-b939-780e7189adb4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:42.995445 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e61eb-d6b0-44ca-b939-780e7189adb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:43.014628 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ed6e61eb-d6b0-44ca-b939-780e7189adb4 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:43.015816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ed6e61eb-d6b0-44ca-b939-780e7189adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:43.070700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1352/2721] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jan 28 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:43.083893 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c014a-c06f-455d-9f04-62a3b075d9dd service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:43.085491 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-719c014a-c06f-455d-9f04-62a3b075d9dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:43.153542 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c014a-c06f-455d-9f04-62a3b075d9dd service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:43.159460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bfccc-ee65-450e-a869-914f4c18134a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:43.160098 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bfccc-ee65-450e-a869-914f4c18134a service swift] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:43.160374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bfccc-ee65-450e-a869-914f4c18134a service swift] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:43.160667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bfccc-ee65-450e-a869-914f4c18134a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:43.169861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bfccc-ee65-450e-a869-914f4c18134a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:43.171457 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2bfccc-ee65-450e-a869-914f4c18134a service swift] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:43.180221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1370/2722] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:34:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:34:45.173797 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e61eb-d6b0-44ca-b939-780e7189adb4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:45.177746 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ed6e61eb-d6b0-44ca-b939-780e7189adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:45.257957 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e61eb-d6b0-44ca-b939-780e7189adb4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:45.262555 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:45.263431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:45.263711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:45.263996 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] PATH_INFO: `/v3/users/ca67647ea67f4812b0c10ea52bbfddbc` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:45.265269 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca67647ea67f4812b0c10ea52bbfddbc)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:45.267359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:45.318641 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca67647ea67f4812b0c10ea52bbfddbc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:45.327534 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca67647ea67f4812b0c10ea52bbfddbc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:45.339430 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca67647ea67f4812b0c10ea52bbfddbc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:45.340185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca67647ea67f4812b0c10ea52bbfddbc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:45.349944 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0ab8e5f5-aac3-4895-b33c-dd38c8b74746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca67647ea67f4812b0c10ea52bbfddbc'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:45.356500 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1353/2723] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:34:45 2022] DELETE /identity/v3/users/ca67647ea67f4812b0c10ea52bbfddbc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:45.539661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bfccc-ee65-450e-a869-914f4c18134a service swift] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:45.556965 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bfccc-ee65-450e-a869-914f4c18134a service swift] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:45.621437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:45.622675 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:45.623016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:45.623286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] PATH_INFO: `/v3/projects/228f75d4dcc04b3ca2d7e2c443e657d6` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:45.624595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228f75d4dcc04b3ca2d7e2c443e657d6)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:45.626532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:45.684588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228f75d4dcc04b3ca2d7e2c443e657d6', 'request_id': 'req-d17e08a0-54c0-4e6f-b778-bb64d46226c6'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:45.691181 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228f75d4dcc04b3ca2d7e2c443e657d6', 'request_id': 'req-d17e08a0-54c0-4e6f-b778-bb64d46226c6'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:45.697619 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228f75d4dcc04b3ca2d7e2c443e657d6', 'request_id': 'req-d17e08a0-54c0-4e6f-b778-bb64d46226c6'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:45.712599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] The token cache is being invalidate because project 228f75d4dcc04b3ca2d7e2c443e657d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:34:45.712813 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:45.713506 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d17e08a0-54c0-4e6f-b778-bb64d46226c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:45.715081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1371/2724] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:34:45 2022] DELETE /identity/v3/projects/228f75d4dcc04b3ca2d7e2c443e657d6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:45.722315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a8aa9-92f4-4193-8532-3969ec3bc099 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:45.722605 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a8aa9-92f4-4193-8532-3969ec3bc099 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:45.722883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a8aa9-92f4-4193-8532-3969ec3bc099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:45.741289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-dc2a8aa9-92f4-4193-8532-3969ec3bc099 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:45.742535 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dc2a8aa9-92f4-4193-8532-3969ec3bc099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:45.806137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1354/2725] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:45.814024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78892e0a-1202-46e5-9650-8a2676ee28a3 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:45.814309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78892e0a-1202-46e5-9650-8a2676ee28a3 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:45.814587 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78892e0a-1202-46e5-9650-8a2676ee28a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:45.837927 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-78892e0a-1202-46e5-9650-8a2676ee28a3 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:45.839255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-78892e0a-1202-46e5-9650-8a2676ee28a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:45.848265 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1372/2726] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:45.852982 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a8aa9-92f4-4193-8532-3969ec3bc099 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:45.863345 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a8aa9-92f4-4193-8532-3969ec3bc099 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:45.869694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6b61-8443-4d92-a59d-b6c1850a09c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:45.870351 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6b61-8443-4d92-a59d-b6c1850a09c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:45.870631 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6b61-8443-4d92-a59d-b6c1850a09c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:45.870896 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6b61-8443-4d92-a59d-b6c1850a09c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:45.871637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e6b61-8443-4d92-a59d-b6c1850a09c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:34:45.871938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e6b61-8443-4d92-a59d-b6c1850a09c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:45.873582 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e6b61-8443-4d92-a59d-b6c1850a09c2 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:45.885978 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1355/2727] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:34:45.890956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78892e0a-1202-46e5-9650-8a2676ee28a3 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:45.902485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78892e0a-1202-46e5-9650-8a2676ee28a3 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:45.908667 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77c038-ac53-47b8-b4a3-03cbcc6d56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:45.909385 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c038-ac53-47b8-b4a3-03cbcc6d56c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:45.909662 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c038-ac53-47b8-b4a3-03cbcc6d56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:45.909930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77c038-ac53-47b8-b4a3-03cbcc6d56c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:45.910625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77c038-ac53-47b8-b4a3-03cbcc6d56c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:45.912573 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77c038-ac53-47b8-b4a3-03cbcc6d56c1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:45.944665 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1373/2728] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:34:45 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:34:45.951482 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6b61-8443-4d92-a59d-b6c1850a09c2 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:45.963682 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6b61-8443-4d92-a59d-b6c1850a09c2 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:46.024168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a67a-2edb-4979-bc03-09d6d9d6b208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:46.024821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a67a-2edb-4979-bc03-09d6d9d6b208 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:46.025094 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a67a-2edb-4979-bc03-09d6d9d6b208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:46.025421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10a67a-2edb-4979-bc03-09d6d9d6b208 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:46.026175 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a67a-2edb-4979-bc03-09d6d9d6b208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:46.028071 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10a67a-2edb-4979-bc03-09d6d9d6b208 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:46.048691 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1356/2729] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:34:45 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:34:46.053164 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77c038-ac53-47b8-b4a3-03cbcc6d56c1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:46.063736 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77c038-ac53-47b8-b4a3-03cbcc6d56c1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:46.068322 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92dca7-1145-40d0-92c1-c503b0ca1546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:46.068998 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92dca7-1145-40d0-92c1-c503b0ca1546 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:46.069306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92dca7-1145-40d0-92c1-c503b0ca1546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:46.069576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92dca7-1145-40d0-92c1-c503b0ca1546 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:46.070303 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92dca7-1145-40d0-92c1-c503b0ca1546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:46.071906 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92dca7-1145-40d0-92c1-c503b0ca1546 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:46.087946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1374/2730] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:34:46.092148 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a67a-2edb-4979-bc03-09d6d9d6b208 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:46.105250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10a67a-2edb-4979-bc03-09d6d9d6b208 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:46.111005 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67040f65-eeb2-4f92-9983-7b6f957303dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:46.111706 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040f65-eeb2-4f92-9983-7b6f957303dc admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:46.111959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040f65-eeb2-4f92-9983-7b6f957303dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:46.112230 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67040f65-eeb2-4f92-9983-7b6f957303dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:46.112963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67040f65-eeb2-4f92-9983-7b6f957303dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:46.114602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67040f65-eeb2-4f92-9983-7b6f957303dc admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:46.125454 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1357/2731] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:34:46.129876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92dca7-1145-40d0-92c1-c503b0ca1546 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:46.140132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92dca7-1145-40d0-92c1-c503b0ca1546 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:46.145135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68692460-69c1-401e-91a2-fec5e464fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:46.146054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68692460-69c1-401e-91a2-fec5e464fe4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:46.146326 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68692460-69c1-401e-91a2-fec5e464fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:46.146599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68692460-69c1-401e-91a2-fec5e464fe4c admin admin] PATH_INFO: `/v3/projects/fa9618e1ab194eeaa2345dcad6d8fc73/users/2901d5107afb4484b98377f4f03854f6/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:46.162374 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68692460-69c1-401e-91a2-fec5e464fe4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9618e1ab194eeaa2345dcad6d8fc73, user_id=2901d5107afb4484b98377f4f03854f6, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:46.165029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68692460-69c1-401e-91a2-fec5e464fe4c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:46.181622 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1375/2732] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:34:46 2022] PUT /identity/v3/projects/fa9618e1ab194eeaa2345dcad6d8fc73/users/2901d5107afb4484b98377f4f03854f6/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:34:46.192771 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89848e-15ad-45cb-b07d-277cc64fef27 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:46.193317 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89848e-15ad-45cb-b07d-277cc64fef27 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:46.193414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89848e-15ad-45cb-b07d-277cc64fef27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:46.220679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3b89848e-15ad-45cb-b07d-277cc64fef27 None None] MFA Rules not processed for user `2901d5107afb4484b98377f4f03854f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:46.221843 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3b89848e-15ad-45cb-b07d-277cc64fef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:46.287816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1358/2733] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:46.300203 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68692460-69c1-401e-91a2-fec5e464fe4c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:46.301468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-68692460-69c1-401e-91a2-fec5e464fe4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:46.359936 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68692460-69c1-401e-91a2-fec5e464fe4c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:46.363615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065f4c5-e582-47a1-b44d-12d1c02e8142 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec2950259d4ed0925d7a19a6217af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:46.364258 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065f4c5-e582-47a1-b44d-12d1c02e8142 service glance] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:46.364540 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065f4c5-e582-47a1-b44d-12d1c02e8142 service glance] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:46.364811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065f4c5-e582-47a1-b44d-12d1c02e8142 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:46.373940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065f4c5-e582-47a1-b44d-12d1c02e8142 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:46.375459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065f4c5-e582-47a1-b44d-12d1c02e8142 service glance] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:46.384315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1376/2734] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:34:46.436780 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89848e-15ad-45cb-b07d-277cc64fef27 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:46.438379 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3b89848e-15ad-45cb-b07d-277cc64fef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:46.512891 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89848e-15ad-45cb-b07d-277cc64fef27 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:46.517922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:46.519036 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:46.519320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:46.519589 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] PATH_INFO: `/v3/users/7759395fbbae4fa4a939edb3ae1fb6e9` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:46.521018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7759395fbbae4fa4a939edb3ae1fb6e9)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:46.522982 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:46.569733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7759395fbbae4fa4a939edb3ae1fb6e9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:46.576531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7759395fbbae4fa4a939edb3ae1fb6e9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:46.589130 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7759395fbbae4fa4a939edb3ae1fb6e9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:46.590051 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7759395fbbae4fa4a939edb3ae1fb6e9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:46.598566 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7759395fbbae4fa4a939edb3ae1fb6e9'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:46.607870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1359/2735] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:34:46 2022] DELETE /identity/v3/users/7759395fbbae4fa4a939edb3ae1fb6e9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:46.609918 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7eaf0-deb2-4c8b-a827-9cb6aedddd7a None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:46.610384 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7eaf0-deb2-4c8b-a827-9cb6aedddd7a None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:46.610505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7eaf0-deb2-4c8b-a827-9cb6aedddd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:46.628367 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-f2f7eaf0-deb2-4c8b-a827-9cb6aedddd7a None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:46.630596 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f2f7eaf0-deb2-4c8b-a827-9cb6aedddd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:46.690551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1377/2736] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:46.700538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:46.702069 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:46.763687 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771865e9-6b01-47d9-a91f-49bca5fbe594 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:46.766784 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2af2-3cff-4927-8b0f-82926bb4e08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:46.767561 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2af2-3cff-4927-8b0f-82926bb4e08d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:46.767913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2af2-3cff-4927-8b0f-82926bb4e08d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:46.768190 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2af2-3cff-4927-8b0f-82926bb4e08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:46.778380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2af2-3cff-4927-8b0f-82926bb4e08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:46.779819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2af2-3cff-4927-8b0f-82926bb4e08d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:46.790649 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1360/2737] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:34:47.071678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7eaf0-deb2-4c8b-a827-9cb6aedddd7a None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:47.073252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f2f7eaf0-deb2-4c8b-a827-9cb6aedddd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:47.086625 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7eaf0-deb2-4c8b-a827-9cb6aedddd7a None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:47.093219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:47.094236 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:47.094611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:47.094976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] PATH_INFO: `/v3/projects/eb78a5a088434f5f9c01a9fcc9e905bf` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:47.096468 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb78a5a088434f5f9c01a9fcc9e905bf)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:47.098602 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:47.156846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb78a5a088434f5f9c01a9fcc9e905bf', 'request_id': 'req-a6bd2690-9868-435c-a391-bdd271260fe1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.163082 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb78a5a088434f5f9c01a9fcc9e905bf', 'request_id': 'req-a6bd2690-9868-435c-a391-bdd271260fe1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.168473 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb78a5a088434f5f9c01a9fcc9e905bf', 'request_id': 'req-a6bd2690-9868-435c-a391-bdd271260fe1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.182222 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] The token cache is being invalidate because project eb78a5a088434f5f9c01a9fcc9e905bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:34:47.182509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.183168 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.184779 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1378/2738] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:34:47 2022] DELETE /identity/v3/projects/eb78a5a088434f5f9c01a9fcc9e905bf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:47.188869 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2af2-3cff-4927-8b0f-82926bb4e08d service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:47.199068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2af2-3cff-4927-8b0f-82926bb4e08d service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:47.259409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:47.260272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:47.260552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:47.260824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] PATH_INFO: `/v3/users/c69b98223f804109b0b3ce551514db26` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:47.262291 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69b98223f804109b0b3ce551514db26)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:47.264209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:47.321752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69b98223f804109b0b3ce551514db26'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.329168 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69b98223f804109b0b3ce551514db26'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.342440 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69b98223f804109b0b3ce551514db26'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.343377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69b98223f804109b0b3ce551514db26'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.354422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-172e8db1-8572-45b1-b3e2-af62620686af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69b98223f804109b0b3ce551514db26'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.361422 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1361/2739] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:34:47 2022] DELETE /identity/v3/users/c69b98223f804109b0b3ce551514db26 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:47.656135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:47.657737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:47.679981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd2690-9868-435c-a391-bdd271260fe1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:47.737250 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:47.738114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:47.738386 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:47.738655 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] PATH_INFO: `/v3/projects/261b9433790a49bdb7385036f85d795e` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:47.740084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261b9433790a49bdb7385036f85d795e)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:47.742223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:47.809361 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261b9433790a49bdb7385036f85d795e', 'request_id': 'req-78392597-c0fb-4a2d-9012-4fcd49b25464'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.819555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261b9433790a49bdb7385036f85d795e', 'request_id': 'req-78392597-c0fb-4a2d-9012-4fcd49b25464'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.827839 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261b9433790a49bdb7385036f85d795e', 'request_id': 'req-78392597-c0fb-4a2d-9012-4fcd49b25464'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.842921 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] The token cache is being invalidate because project 261b9433790a49bdb7385036f85d795e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:34:47.843207 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.843845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-78392597-c0fb-4a2d-9012-4fcd49b25464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:47.845414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1379/2740] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:34:47 2022] DELETE /identity/v3/projects/261b9433790a49bdb7385036f85d795e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:47.852320 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d1bc-c822-4b80-ac24-e4289f36a72b None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:47.852828 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d1bc-c822-4b80-ac24-e4289f36a72b None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:47.852963 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1d1bc-c822-4b80-ac24-e4289f36a72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:47.872489 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d0a1d1bc-c822-4b80-ac24-e4289f36a72b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:47.873770 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d0a1d1bc-c822-4b80-ac24-e4289f36a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:47.947822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1362/2741] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:47.956558 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291a2bf-fbde-4cd9-a3e2-882c0425f9c6 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:47.956867 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291a2bf-fbde-4cd9-a3e2-882c0425f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:47.957146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291a2bf-fbde-4cd9-a3e2-882c0425f9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:47.978064 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-4291a2bf-fbde-4cd9-a3e2-882c0425f9c6 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:47.979381 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-4291a2bf-fbde-4cd9-a3e2-882c0425f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:47.990866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1380/2742] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:47.997115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1d1bc-c822-4b80-ac24-e4289f36a72b None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.009035 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1d1bc-c822-4b80-ac24-e4289f36a72b None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.015358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d7f9b-3c12-4d74-897a-30a37b26745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.016030 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d7f9b-3c12-4d74-897a-30a37b26745e admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.016307 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d7f9b-3c12-4d74-897a-30a37b26745e admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.016577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d7f9b-3c12-4d74-897a-30a37b26745e admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.017431 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d7f9b-3c12-4d74-897a-30a37b26745e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:34:48.017737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d7f9b-3c12-4d74-897a-30a37b26745e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.019352 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d7f9b-3c12-4d74-897a-30a37b26745e admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.031903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1363/2743] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:34:48.037009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291a2bf-fbde-4cd9-a3e2-882c0425f9c6 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.053263 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291a2bf-fbde-4cd9-a3e2-882c0425f9c6 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.060942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886b965-db18-42c5-8fa4-03d9de3fb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.061931 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b965-db18-42c5-8fa4-03d9de3fb7ba admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.062400 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b965-db18-42c5-8fa4-03d9de3fb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.062833 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886b965-db18-42c5-8fa4-03d9de3fb7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.063982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886b965-db18-42c5-8fa4-03d9de3fb7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.067253 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886b965-db18-42c5-8fa4-03d9de3fb7ba admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.108442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1381/2744] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:34:48 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:34:48.113536 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d7f9b-3c12-4d74-897a-30a37b26745e admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.126187 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d7f9b-3c12-4d74-897a-30a37b26745e admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.192644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf4b91-2a32-4dd1-a4c7-aed97ced2484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.193363 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf4b91-2a32-4dd1-a4c7-aed97ced2484 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.193638 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf4b91-2a32-4dd1-a4c7-aed97ced2484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.193907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf4b91-2a32-4dd1-a4c7-aed97ced2484 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.194611 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf4b91-2a32-4dd1-a4c7-aed97ced2484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.196612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf4b91-2a32-4dd1-a4c7-aed97ced2484 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.219413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1364/2745] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:34:48 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:34:48.224291 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886b965-db18-42c5-8fa4-03d9de3fb7ba admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.237460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886b965-db18-42c5-8fa4-03d9de3fb7ba admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.243868 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac576-5697-4ff9-9f29-d63256da32a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.244554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac576-5697-4ff9-9f29-d63256da32a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.244834 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac576-5697-4ff9-9f29-d63256da32a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.245103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac576-5697-4ff9-9f29-d63256da32a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.245946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac576-5697-4ff9-9f29-d63256da32a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.247703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac576-5697-4ff9-9f29-d63256da32a5 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.259346 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1382/2746] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:34:48.264221 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf4b91-2a32-4dd1-a4c7-aed97ced2484 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.279644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf4b91-2a32-4dd1-a4c7-aed97ced2484 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.287056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6c0ec-098a-407f-aae1-83f07343b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.288031 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6c0ec-098a-407f-aae1-83f07343b50c admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.288487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6c0ec-098a-407f-aae1-83f07343b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.288997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6c0ec-098a-407f-aae1-83f07343b50c admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.289799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6c0ec-098a-407f-aae1-83f07343b50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.291383 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6c0ec-098a-407f-aae1-83f07343b50c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.303126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1365/2747] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:34:48.310052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac576-5697-4ff9-9f29-d63256da32a5 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.324844 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac576-5697-4ff9-9f29-d63256da32a5 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.330320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d8e3-1a82-4370-a711-e7e0d97994e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.331210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d8e3-1a82-4370-a711-e7e0d97994e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.331489 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d8e3-1a82-4370-a711-e7e0d97994e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.331753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d8e3-1a82-4370-a711-e7e0d97994e8 admin admin] PATH_INFO: `/v3/projects/e3b70aba2da34a059475977f226a5be9/users/921c6f70554340cbb5c0564bb234ac1c/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.346484 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38d8e3-1a82-4370-a711-e7e0d97994e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b70aba2da34a059475977f226a5be9, user_id=921c6f70554340cbb5c0564bb234ac1c, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.349341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38d8e3-1a82-4370-a711-e7e0d97994e8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.367086 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1383/2748] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:34:48 2022] PUT /identity/v3/projects/e3b70aba2da34a059475977f226a5be9/users/921c6f70554340cbb5c0564bb234ac1c/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:48.380058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c1dea-b32c-45b9-9e6a-31f7d094fe90 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.380466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c1dea-b32c-45b9-9e6a-31f7d094fe90 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.380741 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c1dea-b32c-45b9-9e6a-31f7d094fe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.411772 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-d40c1dea-b32c-45b9-9e6a-31f7d094fe90 None None] MFA Rules not processed for user `921c6f70554340cbb5c0564bb234ac1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:48.412985 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d40c1dea-b32c-45b9-9e6a-31f7d094fe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:48.495429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1366/2749] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:48.500114 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d8e3-1a82-4370-a711-e7e0d97994e8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.569075 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d8e3-1a82-4370-a711-e7e0d97994e8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.574923 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97724348-a4e1-4e95-a1eb-7fc1afb28218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.575507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97724348-a4e1-4e95-a1eb-7fc1afb28218 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.575782 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97724348-a4e1-4e95-a1eb-7fc1afb28218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.576051 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97724348-a4e1-4e95-a1eb-7fc1afb28218 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.576763 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97724348-a4e1-4e95-a1eb-7fc1afb28218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.578721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97724348-a4e1-4e95-a1eb-7fc1afb28218 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.605908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1384/2750] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:34:48 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:34:48.614353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c1dea-b32c-45b9-9e6a-31f7d094fe90 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.630367 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c1dea-b32c-45b9-9e6a-31f7d094fe90 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.690331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f70c63-8d07-4633-95e4-2f29621a2e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.691032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70c63-8d07-4633-95e4-2f29621a2e50 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.691310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70c63-8d07-4633-95e4-2f29621a2e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.691579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70c63-8d07-4633-95e4-2f29621a2e50 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.692310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f70c63-8d07-4633-95e4-2f29621a2e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.694436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f70c63-8d07-4633-95e4-2f29621a2e50 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.716219 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1367/2751] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:34:48 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:34:48.720554 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97724348-a4e1-4e95-a1eb-7fc1afb28218 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.731176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97724348-a4e1-4e95-a1eb-7fc1afb28218 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.736465 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2507fe3-0b4b-40d5-bf35-94573281792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.737132 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2507fe3-0b4b-40d5-bf35-94573281792b admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.737437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2507fe3-0b4b-40d5-bf35-94573281792b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.737705 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2507fe3-0b4b-40d5-bf35-94573281792b admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.738474 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2507fe3-0b4b-40d5-bf35-94573281792b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.740196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2507fe3-0b4b-40d5-bf35-94573281792b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.751240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1385/2752] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:34:48.757038 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f70c63-8d07-4633-95e4-2f29621a2e50 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.768958 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f70c63-8d07-4633-95e4-2f29621a2e50 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.775017 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34832401-901f-4bbd-b2f6-17aed6f6e508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.776154 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34832401-901f-4bbd-b2f6-17aed6f6e508 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.776518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34832401-901f-4bbd-b2f6-17aed6f6e508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.776962 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34832401-901f-4bbd-b2f6-17aed6f6e508 admin admin] PATH_INFO: `/v3/projects/15f391a4172b4455949f1ce5eadb07a4/users/0bacc07276394e29919ef3c4c8fc9968/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.794999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34832401-901f-4bbd-b2f6-17aed6f6e508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f391a4172b4455949f1ce5eadb07a4, user_id=0bacc07276394e29919ef3c4c8fc9968, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.797659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34832401-901f-4bbd-b2f6-17aed6f6e508 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.814165 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1368/2753] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:34:48 2022] PUT /identity/v3/projects/15f391a4172b4455949f1ce5eadb07a4/users/0bacc07276394e29919ef3c4c8fc9968/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:48.819119 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2507fe3-0b4b-40d5-bf35-94573281792b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.835887 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2507fe3-0b4b-40d5-bf35-94573281792b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.894018 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996730d3-0304-403c-b5d9-d9025215142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.894699 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996730d3-0304-403c-b5d9-d9025215142a admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.894966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996730d3-0304-403c-b5d9-d9025215142a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.895236 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996730d3-0304-403c-b5d9-d9025215142a admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.896103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996730d3-0304-403c-b5d9-d9025215142a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.897720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996730d3-0304-403c-b5d9-d9025215142a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.909974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1386/2754] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:34:48.914667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34832401-901f-4bbd-b2f6-17aed6f6e508 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:48.925577 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34832401-901f-4bbd-b2f6-17aed6f6e508 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:48.930936 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b42cd-21bc-495a-a1ca-8a98b9c70f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:48.931817 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b42cd-21bc-495a-a1ca-8a98b9c70f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.932092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b42cd-21bc-495a-a1ca-8a98b9c70f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.932359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b42cd-21bc-495a-a1ca-8a98b9c70f74 admin admin] PATH_INFO: `/v3/projects/15f391a4172b4455949f1ce5eadb07a4/users/0bacc07276394e29919ef3c4c8fc9968/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.934395 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b42cd-21bc-495a-a1ca-8a98b9c70f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f391a4172b4455949f1ce5eadb07a4, user_id=0bacc07276394e29919ef3c4c8fc9968, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:48.937008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b42cd-21bc-495a-a1ca-8a98b9c70f74 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:48.948241 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1369/2755] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:34:48 2022] PUT /identity/v3/projects/15f391a4172b4455949f1ce5eadb07a4/users/0bacc07276394e29919ef3c4c8fc9968/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:48.961099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffafb35-1609-4db4-852b-1e598570ea36 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:48.961703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffafb35-1609-4db4-852b-1e598570ea36 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:48.961870 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffafb35-1609-4db4-852b-1e598570ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:48.992559 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-5ffafb35-1609-4db4-852b-1e598570ea36 None None] MFA Rules not processed for user `0bacc07276394e29919ef3c4c8fc9968`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:48.993805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5ffafb35-1609-4db4-852b-1e598570ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:49.063375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1387/2756] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:49.076251 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b42cd-21bc-495a-a1ca-8a98b9c70f74 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:49.078717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f81b42cd-21bc-495a-a1ca-8a98b9c70f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:49.158682 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b42cd-21bc-495a-a1ca-8a98b9c70f74 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:49.163476 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb221ec-ea4d-463c-af01-78d2d28fad74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:49.164343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb221ec-ea4d-463c-af01-78d2d28fad74 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:49.164747 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb221ec-ea4d-463c-af01-78d2d28fad74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:49.165072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb221ec-ea4d-463c-af01-78d2d28fad74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:49.179955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb221ec-ea4d-463c-af01-78d2d28fad74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:49.182292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb221ec-ea4d-463c-af01-78d2d28fad74 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:49.195849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1370/2757] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:34:49.245563 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffafb35-1609-4db4-852b-1e598570ea36 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:49.247309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5ffafb35-1609-4db4-852b-1e598570ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:49.263774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffafb35-1609-4db4-852b-1e598570ea36 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:49.268091 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb1339-84df-4135-9f40-f081f37c1780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:49.268769 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1339-84df-4135-9f40-f081f37c1780 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:49.269049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1339-84df-4135-9f40-f081f37c1780 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:49.269380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1339-84df-4135-9f40-f081f37c1780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:49.328856 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb1339-84df-4135-9f40-f081f37c1780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:49.330873 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb1339-84df-4135-9f40-f081f37c1780 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:49.343088 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1388/2758] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:34:52.765657 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb221ec-ea4d-463c-af01-78d2d28fad74 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:52.830953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb221ec-ea4d-463c-af01-78d2d28fad74 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:52.835820 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:52.836694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:52.836970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:52.837387 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] PATH_INFO: `/v3/users/921c6f70554340cbb5c0564bb234ac1c` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:52.840075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=921c6f70554340cbb5c0564bb234ac1c)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:52.845854 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:52.901090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '921c6f70554340cbb5c0564bb234ac1c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:52.912195 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '921c6f70554340cbb5c0564bb234ac1c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:52.924678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '921c6f70554340cbb5c0564bb234ac1c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:52.925548 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '921c6f70554340cbb5c0564bb234ac1c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:52.934149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '921c6f70554340cbb5c0564bb234ac1c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:52.940400 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1371/2759] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:34:52 2022] DELETE /identity/v3/users/921c6f70554340cbb5c0564bb234ac1c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:52.945357 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c584e-5077-4285-bf17-cc3580edf800 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:52.945935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c584e-5077-4285-bf17-cc3580edf800 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:52.945935 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c584e-5077-4285-bf17-cc3580edf800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:52.967544 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-416c584e-5077-4285-bf17-cc3580edf800 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:52.969359 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-416c584e-5077-4285-bf17-cc3580edf800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:53.030505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1389/2760] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:53.041460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:53.043014 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:53.117308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83ed30-dd89-4870-93d0-cfd6cfd97d1f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:53.121946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c2247-65c0-4cde-91ac-e68ecf861c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:53.122654 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c2247-65c0-4cde-91ac-e68ecf861c03 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:53.122970 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c2247-65c0-4cde-91ac-e68ecf861c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:53.123159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c2247-65c0-4cde-91ac-e68ecf861c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:53.138713 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c2247-65c0-4cde-91ac-e68ecf861c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:53.140802 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c2247-65c0-4cde-91ac-e68ecf861c03 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:53.155849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1372/2761] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:34:53.467669 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c584e-5077-4285-bf17-cc3580edf800 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:53.469507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-416c584e-5077-4285-bf17-cc3580edf800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:53.482843 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c584e-5077-4285-bf17-cc3580edf800 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:53.488886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:53.490066 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:53.490327 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:53.490633 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] PATH_INFO: `/v3/projects/e3b70aba2da34a059475977f226a5be9` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:53.492846 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b70aba2da34a059475977f226a5be9)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:53.495057 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:53.550695 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b70aba2da34a059475977f226a5be9', 'request_id': 'req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:53.557438 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b70aba2da34a059475977f226a5be9', 'request_id': 'req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:53.563096 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b70aba2da34a059475977f226a5be9', 'request_id': 'req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:53.586024 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] The token cache is being invalidate because project e3b70aba2da34a059475977f226a5be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:34:53.586536 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:53.588127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:53.591703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1390/2762] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:34:53 2022] DELETE /identity/v3/projects/e3b70aba2da34a059475977f226a5be9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:34:53.596429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c2247-65c0-4cde-91ac-e68ecf861c03 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:53.606439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c2247-65c0-4cde-91ac-e68ecf861c03 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:53.675583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:53.676812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:53.677184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:53.677575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] PATH_INFO: `/v3/users/0bacc07276394e29919ef3c4c8fc9968` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:53.679200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bacc07276394e29919ef3c4c8fc9968)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:53.681469 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:53.742127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bacc07276394e29919ef3c4c8fc9968'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:53.749473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bacc07276394e29919ef3c4c8fc9968'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:53.766459 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bacc07276394e29919ef3c4c8fc9968'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:53.767429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bacc07276394e29919ef3c4c8fc9968'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:53.776930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-ce4d5e44-be88-4788-bcf1-27cbc5ff49d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bacc07276394e29919ef3c4c8fc9968'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:53.784060 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1373/2763] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:34:53 2022] DELETE /identity/v3/users/0bacc07276394e29919ef3c4c8fc9968 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:54.097599 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:54.099598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:54.113421 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb310d-7d0c-4897-a597-f2d0ad702a8d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:54.183306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:54.184209 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:54.184483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:54.184761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] PATH_INFO: `/v3/projects/15f391a4172b4455949f1ce5eadb07a4` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:54.186025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f391a4172b4455949f1ce5eadb07a4)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:54.187956 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:54.245508 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f391a4172b4455949f1ce5eadb07a4', 'request_id': 'req-4706eef0-45c2-4dff-bf00-e5cdc65186a1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:54.252514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f391a4172b4455949f1ce5eadb07a4', 'request_id': 'req-4706eef0-45c2-4dff-bf00-e5cdc65186a1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:54.259281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f391a4172b4455949f1ce5eadb07a4', 'request_id': 'req-4706eef0-45c2-4dff-bf00-e5cdc65186a1'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:54.274547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] The token cache is being invalidate because project 15f391a4172b4455949f1ce5eadb07a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:34:54.274847 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:54.275509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-4706eef0-45c2-4dff-bf00-e5cdc65186a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:34:54.277197 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1391/2764] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:34:54 2022] DELETE /identity/v3/projects/15f391a4172b4455949f1ce5eadb07a4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:34:54.283306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147cc38-cdd5-4239-988c-26a5b4bb29f9 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:54.283588 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147cc38-cdd5-4239-988c-26a5b4bb29f9 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:54.283861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147cc38-cdd5-4239-988c-26a5b4bb29f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:54.306601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-7147cc38-cdd5-4239-988c-26a5b4bb29f9 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:54.307828 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-7147cc38-cdd5-4239-988c-26a5b4bb29f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:54.380145 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1374/2765] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:54.389670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a61d29-8d22-446f-988e-8fbd0362954f None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:54.389937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a61d29-8d22-446f-988e-8fbd0362954f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:54.390215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a61d29-8d22-446f-988e-8fbd0362954f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:54.411244 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-30a61d29-8d22-446f-988e-8fbd0362954f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:54.412556 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-30a61d29-8d22-446f-988e-8fbd0362954f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:54.421499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1392/2766] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:54.427752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147cc38-cdd5-4239-988c-26a5b4bb29f9 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:54.443892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147cc38-cdd5-4239-988c-26a5b4bb29f9 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:54.452240 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4579ee-41e7-4656-9e9b-8afbc61688a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:54.453428 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4579ee-41e7-4656-9e9b-8afbc61688a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:54.453912 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4579ee-41e7-4656-9e9b-8afbc61688a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:54.454421 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4579ee-41e7-4656-9e9b-8afbc61688a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:54.455786 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4579ee-41e7-4656-9e9b-8afbc61688a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:34:54.456243 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4579ee-41e7-4656-9e9b-8afbc61688a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:54.459019 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4579ee-41e7-4656-9e9b-8afbc61688a1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:54.473319 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1375/2767] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:34:54.478417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a61d29-8d22-446f-988e-8fbd0362954f None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:54.489704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a61d29-8d22-446f-988e-8fbd0362954f None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:54.495058 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064483c-8da3-41d9-99df-167fc40d7342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:54.495886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064483c-8da3-41d9-99df-167fc40d7342 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:54.496166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064483c-8da3-41d9-99df-167fc40d7342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:54.496442 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064483c-8da3-41d9-99df-167fc40d7342 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:54.497189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064483c-8da3-41d9-99df-167fc40d7342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:54.499267 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064483c-8da3-41d9-99df-167fc40d7342 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:54.537678 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1393/2768] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:34:54 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:34:54.542024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4579ee-41e7-4656-9e9b-8afbc61688a1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:54.556657 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4579ee-41e7-4656-9e9b-8afbc61688a1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:54.619547 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a6a7e-b013-481f-a173-bd34c74df7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:54.620277 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a6a7e-b013-481f-a173-bd34c74df7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:54.620789 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a6a7e-b013-481f-a173-bd34c74df7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:54.621066 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a6a7e-b013-481f-a173-bd34c74df7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:54.621880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a6a7e-b013-481f-a173-bd34c74df7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:54.623977 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a6a7e-b013-481f-a173-bd34c74df7e4 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:54.648414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1376/2769] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:34:54 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:34:54.653118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064483c-8da3-41d9-99df-167fc40d7342 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:54.664320 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064483c-8da3-41d9-99df-167fc40d7342 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:54.669692 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b1a8d-27bd-4613-8430-f452a0c91395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:54.670423 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b1a8d-27bd-4613-8430-f452a0c91395 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:54.670743 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b1a8d-27bd-4613-8430-f452a0c91395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:54.671052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b1a8d-27bd-4613-8430-f452a0c91395 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:54.671908 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b1a8d-27bd-4613-8430-f452a0c91395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:54.673621 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b1a8d-27bd-4613-8430-f452a0c91395 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:54.685213 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1394/2770] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:34:54.689734 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a6a7e-b013-481f-a173-bd34c74df7e4 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:54.701268 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a6a7e-b013-481f-a173-bd34c74df7e4 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:54.707184 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad524509-a4ab-46a6-a09b-2bb79c1a7b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:54.707845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad524509-a4ab-46a6-a09b-2bb79c1a7b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:54.708162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad524509-a4ab-46a6-a09b-2bb79c1a7b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:54.708463 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad524509-a4ab-46a6-a09b-2bb79c1a7b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:54.709220 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad524509-a4ab-46a6-a09b-2bb79c1a7b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:54.710899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad524509-a4ab-46a6-a09b-2bb79c1a7b76 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:54.722182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1377/2771] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:34:54.727332 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b1a8d-27bd-4613-8430-f452a0c91395 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:54.745215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b1a8d-27bd-4613-8430-f452a0c91395 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:54.753252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2ac1d-a7c6-455c-adf8-b50f9f94927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:54.754694 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2ac1d-a7c6-455c-adf8-b50f9f94927e admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:54.755164 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2ac1d-a7c6-455c-adf8-b50f9f94927e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:54.755566 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2ac1d-a7c6-455c-adf8-b50f9f94927e admin admin] PATH_INFO: `/v3/projects/8b3cda6b1f1f4cb7aaa8f4f4d80bbe35/users/472ae2df04b24fe0b8690f34394f4e40/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:54.776226 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2ac1d-a7c6-455c-adf8-b50f9f94927e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3cda6b1f1f4cb7aaa8f4f4d80bbe35, user_id=472ae2df04b24fe0b8690f34394f4e40, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:54.781019 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2ac1d-a7c6-455c-adf8-b50f9f94927e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:54.802780 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1395/2772] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:34:54 2022] PUT /identity/v3/projects/8b3cda6b1f1f4cb7aaa8f4f4d80bbe35/users/472ae2df04b24fe0b8690f34394f4e40/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:34:54.817583 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fa94f-ca00-45d6-8b2c-cc2dd502c012 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:54.818196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fa94f-ca00-45d6-8b2c-cc2dd502c012 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:54.818196 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fa94f-ca00-45d6-8b2c-cc2dd502c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:54.852613 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-419fa94f-ca00-45d6-8b2c-cc2dd502c012 None None] MFA Rules not processed for user `472ae2df04b24fe0b8690f34394f4e40`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:34:54.853939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-419fa94f-ca00-45d6-8b2c-cc2dd502c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:54.939378 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1378/2773] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:34:54.950264 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2ac1d-a7c6-455c-adf8-b50f9f94927e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:34:54.952628 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-f8c2ac1d-a7c6-455c-adf8-b50f9f94927e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:34:55.023040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2ac1d-a7c6-455c-adf8-b50f9f94927e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:34:55.027094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50fe9-216c-440b-b2d6-28efa3f904b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:34:55.027752 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50fe9-216c-440b-b2d6-28efa3f904b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:34:55.028030 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50fe9-216c-440b-b2d6-28efa3f904b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:34:55.028296 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50fe9-216c-440b-b2d6-28efa3f904b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:34:55.038389 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d50fe9-216c-440b-b2d6-28efa3f904b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:34:55.040586 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d50fe9-216c-440b-b2d6-28efa3f904b2 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:34:55.055840 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1396/2774] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:34:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:04.664143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fa94f-ca00-45d6-8b2c-cc2dd502c012 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:04.736717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fa94f-ca00-45d6-8b2c-cc2dd502c012 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:04.741865 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:04.742766 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:04.743133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:04.743362 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] PATH_INFO: `/v3/users/472ae2df04b24fe0b8690f34394f4e40` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:04.744513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=472ae2df04b24fe0b8690f34394f4e40)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:04.746558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:04.802308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472ae2df04b24fe0b8690f34394f4e40'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:04.810059 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472ae2df04b24fe0b8690f34394f4e40'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:04.825883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472ae2df04b24fe0b8690f34394f4e40'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:04.826726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472ae2df04b24fe0b8690f34394f4e40'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:04.840340 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472ae2df04b24fe0b8690f34394f4e40'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:04.848586 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1379/2775] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:35:04 2022] DELETE /identity/v3/users/472ae2df04b24fe0b8690f34394f4e40 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:04.854488 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb41c2-d58c-4e08-8951-5129279cc29d None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:04.855000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb41c2-d58c-4e08-8951-5129279cc29d None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:04.855107 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb41c2-d58c-4e08-8951-5129279cc29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:04.875369 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-29cb41c2-d58c-4e08-8951-5129279cc29d None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:04.877985 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-29cb41c2-d58c-4e08-8951-5129279cc29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:04.950239 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1397/2776] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:04.960626 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:04.962147 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:05.019621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b688588-8452-4d12-a951-46088d4cb0d1 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:05.024329 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958a164-19be-4ac2-ae18-0f1bc3ade606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:05.024980 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a164-19be-4ac2-ae18-0f1bc3ade606 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.025260 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a164-19be-4ac2-ae18-0f1bc3ade606 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.025552 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958a164-19be-4ac2-ae18-0f1bc3ade606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:05.035990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958a164-19be-4ac2-ae18-0f1bc3ade606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:05.037576 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958a164-19be-4ac2-ae18-0f1bc3ade606 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:05.049998 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1380/2777] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:05.354634 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb41c2-d58c-4e08-8951-5129279cc29d None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:05.356099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-29cb41c2-d58c-4e08-8951-5129279cc29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:05.371746 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb41c2-d58c-4e08-8951-5129279cc29d None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:05.378495 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:05.379539 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.379937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.380260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] PATH_INFO: `/v3/projects/8b3cda6b1f1f4cb7aaa8f4f4d80bbe35` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:05.381510 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3cda6b1f1f4cb7aaa8f4f4d80bbe35)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:05.383569 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:05.440694 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3cda6b1f1f4cb7aaa8f4f4d80bbe35', 'request_id': 'req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:05.447630 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3cda6b1f1f4cb7aaa8f4f4d80bbe35', 'request_id': 'req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:05.454376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3cda6b1f1f4cb7aaa8f4f4d80bbe35', 'request_id': 'req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:05.471276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] The token cache is being invalidate because project 8b3cda6b1f1f4cb7aaa8f4f4d80bbe35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:35:05.471563 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:05.472317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-dbbe5b73-8b18-44e0-b2be-abcf3ff99082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:05.474048 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1398/2778] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:35:05 2022] DELETE /identity/v3/projects/8b3cda6b1f1f4cb7aaa8f4f4d80bbe35 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:05.483538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c41d3-ac6b-4a87-a583-4bb855a3a8d4 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.483868 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c41d3-ac6b-4a87-a583-4bb855a3a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.484137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c41d3-ac6b-4a87-a583-4bb855a3a8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:05.503516 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a65c41d3-ac6b-4a87-a583-4bb855a3a8d4 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:05.504733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a65c41d3-ac6b-4a87-a583-4bb855a3a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:05.567015 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1381/2779] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:05.575603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0e897-4105-4cbb-a109-c5eee1d05a50 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.575888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0e897-4105-4cbb-a109-c5eee1d05a50 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.576159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0e897-4105-4cbb-a109-c5eee1d05a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:05.596547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-00d0e897-4105-4cbb-a109-c5eee1d05a50 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:05.597848 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-00d0e897-4105-4cbb-a109-c5eee1d05a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:05.606989 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1399/2780] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:05.611585 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c41d3-ac6b-4a87-a583-4bb855a3a8d4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:05.623546 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c41d3-ac6b-4a87-a583-4bb855a3a8d4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:05.628708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabf4e4-d82d-4d02-b094-0edaf7b0abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:05.629444 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabf4e4-d82d-4d02-b094-0edaf7b0abcb admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.629997 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabf4e4-d82d-4d02-b094-0edaf7b0abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.630287 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabf4e4-d82d-4d02-b094-0edaf7b0abcb admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:05.630966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabf4e4-d82d-4d02-b094-0edaf7b0abcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:35:05.631251 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabf4e4-d82d-4d02-b094-0edaf7b0abcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:05.632870 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabf4e4-d82d-4d02-b094-0edaf7b0abcb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:05.647644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1382/2781] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:35:05.652210 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0e897-4105-4cbb-a109-c5eee1d05a50 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:05.663312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0e897-4105-4cbb-a109-c5eee1d05a50 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:05.668966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14278d7f-0415-42c3-af93-a868ad892324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:05.669676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14278d7f-0415-42c3-af93-a868ad892324 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.669957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14278d7f-0415-42c3-af93-a868ad892324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.670227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14278d7f-0415-42c3-af93-a868ad892324 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:05.670937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14278d7f-0415-42c3-af93-a868ad892324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:05.672845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14278d7f-0415-42c3-af93-a868ad892324 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:05.703995 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1400/2782] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:35:05 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:35:05.708460 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabf4e4-d82d-4d02-b094-0edaf7b0abcb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:05.722558 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabf4e4-d82d-4d02-b094-0edaf7b0abcb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:05.800982 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938230-57ab-411a-ad69-4bf8535e0f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:05.801745 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938230-57ab-411a-ad69-4bf8535e0f32 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.802021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938230-57ab-411a-ad69-4bf8535e0f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.802296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65938230-57ab-411a-ad69-4bf8535e0f32 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:05.803021 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938230-57ab-411a-ad69-4bf8535e0f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:05.804946 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65938230-57ab-411a-ad69-4bf8535e0f32 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:05.828680 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1383/2783] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:35:05 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:35:05.834262 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14278d7f-0415-42c3-af93-a868ad892324 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:05.848703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14278d7f-0415-42c3-af93-a868ad892324 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:05.853950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa24814-4bc0-4964-8db3-ab48c7fcd9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:05.854610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24814-4bc0-4964-8db3-ab48c7fcd9fa admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.855206 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24814-4bc0-4964-8db3-ab48c7fcd9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.855206 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24814-4bc0-4964-8db3-ab48c7fcd9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:05.855902 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa24814-4bc0-4964-8db3-ab48c7fcd9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:05.857612 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa24814-4bc0-4964-8db3-ab48c7fcd9fa admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:05.869445 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1401/2784] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:05.873671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938230-57ab-411a-ad69-4bf8535e0f32 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:05.885720 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65938230-57ab-411a-ad69-4bf8535e0f32 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:05.890924 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30bb67-ce4b-4324-89a8-5cd66b2835b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:05.891603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bb67-ce4b-4324-89a8-5cd66b2835b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.891888 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bb67-ce4b-4324-89a8-5cd66b2835b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.892165 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bb67-ce4b-4324-89a8-5cd66b2835b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:05.892930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30bb67-ce4b-4324-89a8-5cd66b2835b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:05.894624 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30bb67-ce4b-4324-89a8-5cd66b2835b6 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:05.905939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1384/2785] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:05.910588 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa24814-4bc0-4964-8db3-ab48c7fcd9fa admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:05.924240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa24814-4bc0-4964-8db3-ab48c7fcd9fa admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:05.930431 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f39909-c84f-4108-b1bc-ce0cdb7919b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:05.931323 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f39909-c84f-4108-b1bc-ce0cdb7919b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.931598 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f39909-c84f-4108-b1bc-ce0cdb7919b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.931871 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f39909-c84f-4108-b1bc-ce0cdb7919b6 admin admin] PATH_INFO: `/v3/projects/9d5140171718487080a1655a6da673d3/users/6e98a6e08f074df8a554ad1ac40d797b/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:05.948358 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f39909-c84f-4108-b1bc-ce0cdb7919b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5140171718487080a1655a6da673d3, user_id=6e98a6e08f074df8a554ad1ac40d797b, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:05.951052 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f39909-c84f-4108-b1bc-ce0cdb7919b6 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:05.967850 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1402/2786] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:35:05 2022] PUT /identity/v3/projects/9d5140171718487080a1655a6da673d3/users/6e98a6e08f074df8a554ad1ac40d797b/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:35:05.978157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffef1bc-5714-44c1-9bc6-198f44f12bbe None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:05.978447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffef1bc-5714-44c1-9bc6-198f44f12bbe None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:05.978724 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffef1bc-5714-44c1-9bc6-198f44f12bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.009708 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-3ffef1bc-5714-44c1-9bc6-198f44f12bbe None None] MFA Rules not processed for user `6e98a6e08f074df8a554ad1ac40d797b`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:06.011126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3ffef1bc-5714-44c1-9bc6-198f44f12bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:06.081992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1385/2787] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:06.086966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f39909-c84f-4108-b1bc-ce0cdb7919b6 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:06.151376 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f39909-c84f-4108-b1bc-ce0cdb7919b6 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:06.157279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fa42d-132d-48e3-ae0d-cfde57fde21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:06.158176 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fa42d-132d-48e3-ae0d-cfde57fde21c admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:06.158459 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fa42d-132d-48e3-ae0d-cfde57fde21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:06.158731 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fa42d-132d-48e3-ae0d-cfde57fde21c admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.159774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fa42d-132d-48e3-ae0d-cfde57fde21c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:06.163040 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fa42d-132d-48e3-ae0d-cfde57fde21c admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:06.201981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1403/2788] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:35:06 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:35:06.207663 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffef1bc-5714-44c1-9bc6-198f44f12bbe None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:06.222932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffef1bc-5714-44c1-9bc6-198f44f12bbe None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:06.310549 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639b13-cf13-4787-93da-d3d7ae567812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:06.311622 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639b13-cf13-4787-93da-d3d7ae567812 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:06.312074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639b13-cf13-4787-93da-d3d7ae567812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:06.312531 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9639b13-cf13-4787-93da-d3d7ae567812 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.313775 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9639b13-cf13-4787-93da-d3d7ae567812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:06.318815 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9639b13-cf13-4787-93da-d3d7ae567812 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:06.342010 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1386/2789] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:35:06 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:35:06.346341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fa42d-132d-48e3-ae0d-cfde57fde21c admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:06.357419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fa42d-132d-48e3-ae0d-cfde57fde21c admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:06.363281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365185f-a682-446a-bea6-7711602173c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:06.364917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365185f-a682-446a-bea6-7711602173c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:06.365243 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365185f-a682-446a-bea6-7711602173c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:06.365534 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365185f-a682-446a-bea6-7711602173c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.366610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365185f-a682-446a-bea6-7711602173c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:06.368240 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365185f-a682-446a-bea6-7711602173c2 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:06.379547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1404/2790] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:06.384244 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639b13-cf13-4787-93da-d3d7ae567812 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:06.395367 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9639b13-cf13-4787-93da-d3d7ae567812 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:06.400174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1ddc2-368b-4f53-aa0f-936b21875f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:06.400841 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ddc2-368b-4f53-aa0f-936b21875f52 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:06.401114 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ddc2-368b-4f53-aa0f-936b21875f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:06.401406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1ddc2-368b-4f53-aa0f-936b21875f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.402153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1ddc2-368b-4f53-aa0f-936b21875f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:06.403731 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1ddc2-368b-4f53-aa0f-936b21875f52 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:06.414413 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1387/2791] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:06.418738 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365185f-a682-446a-bea6-7711602173c2 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:06.429305 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365185f-a682-446a-bea6-7711602173c2 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:06.434301 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76421572-19ce-46c7-829b-18fa20c5a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:06.435196 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421572-19ce-46c7-829b-18fa20c5a08d admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:06.435470 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421572-19ce-46c7-829b-18fa20c5a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:06.435742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421572-19ce-46c7-829b-18fa20c5a08d admin admin] PATH_INFO: `/v3/projects/18119d0f884441ecb2bd726160a78491/users/3f3a955c480a47ebb1112d7cc77e16c3/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.453859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76421572-19ce-46c7-829b-18fa20c5a08d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18119d0f884441ecb2bd726160a78491, user_id=3f3a955c480a47ebb1112d7cc77e16c3, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:06.456761 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76421572-19ce-46c7-829b-18fa20c5a08d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:06.471530 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1405/2792] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:35:06 2022] PUT /identity/v3/projects/18119d0f884441ecb2bd726160a78491/users/3f3a955c480a47ebb1112d7cc77e16c3/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:06.484150 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db1dc-5cb2-4846-9ec7-dfe65f03ae19 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:06.484398 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db1dc-5cb2-4846-9ec7-dfe65f03ae19 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:06.484657 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db1dc-5cb2-4846-9ec7-dfe65f03ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.522560 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4a3db1dc-5cb2-4846-9ec7-dfe65f03ae19 None None] MFA Rules not processed for user `3f3a955c480a47ebb1112d7cc77e16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:06.524575 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4a3db1dc-5cb2-4846-9ec7-dfe65f03ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:06.607049 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1388/2793] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:06.612003 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76421572-19ce-46c7-829b-18fa20c5a08d admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:06.679640 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76421572-19ce-46c7-829b-18fa20c5a08d admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:06.684469 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f87cae-02b8-47e2-b61e-a871518537b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:06.685205 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f87cae-02b8-47e2-b61e-a871518537b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:06.685494 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f87cae-02b8-47e2-b61e-a871518537b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:06.685767 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f87cae-02b8-47e2-b61e-a871518537b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.686490 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f87cae-02b8-47e2-b61e-a871518537b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:06.688429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f87cae-02b8-47e2-b61e-a871518537b3 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:06.716648 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1406/2794] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:35:06 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:35:06.722152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3db1dc-5cb2-4846-9ec7-dfe65f03ae19 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:06.733876 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3db1dc-5cb2-4846-9ec7-dfe65f03ae19 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:06.795513 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b3c7a-0f1f-4519-9e40-c7c0bbb79d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:06.796108 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b3c7a-0f1f-4519-9e40-c7c0bbb79d41 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:06.796405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b3c7a-0f1f-4519-9e40-c7c0bbb79d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:06.796683 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b3c7a-0f1f-4519-9e40-c7c0bbb79d41 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.797430 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b3c7a-0f1f-4519-9e40-c7c0bbb79d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:06.799415 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b3c7a-0f1f-4519-9e40-c7c0bbb79d41 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:06.825178 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1389/2795] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:35:06 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:35:06.829388 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f87cae-02b8-47e2-b61e-a871518537b3 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:06.843579 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f87cae-02b8-47e2-b61e-a871518537b3 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:06.848701 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1df53-73e4-4cb2-8745-2384ef0be5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:06.849414 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1df53-73e4-4cb2-8745-2384ef0be5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:06.849806 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1df53-73e4-4cb2-8745-2384ef0be5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:06.849968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1df53-73e4-4cb2-8745-2384ef0be5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.850703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1df53-73e4-4cb2-8745-2384ef0be5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:06.852306 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1df53-73e4-4cb2-8745-2384ef0be5c1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:06.868315 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1407/2796] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:06.874146 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b3c7a-0f1f-4519-9e40-c7c0bbb79d41 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:06.885085 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b3c7a-0f1f-4519-9e40-c7c0bbb79d41 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:06.890564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de0def-164d-407f-ad7e-65dadb8a7827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:06.891461 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de0def-164d-407f-ad7e-65dadb8a7827 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:06.891721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de0def-164d-407f-ad7e-65dadb8a7827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:06.892012 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de0def-164d-407f-ad7e-65dadb8a7827 admin admin] PATH_INFO: `/v3/projects/1be73add26674c42b65ac6a47665f58f/users/0932e9cff4814416946463b483b237f3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:06.909545 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de0def-164d-407f-ad7e-65dadb8a7827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be73add26674c42b65ac6a47665f58f, user_id=0932e9cff4814416946463b483b237f3, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:06.912358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de0def-164d-407f-ad7e-65dadb8a7827 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:06.929928 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1390/2797] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:35:06 2022] PUT /identity/v3/projects/1be73add26674c42b65ac6a47665f58f/users/0932e9cff4814416946463b483b237f3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:06.934567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1df53-73e4-4cb2-8745-2384ef0be5c1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:06.945929 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1df53-73e4-4cb2-8745-2384ef0be5c1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:07.009650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975992f-35e0-4442-a56f-74028fabfb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:07.009976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975992f-35e0-4442-a56f-74028fabfb15 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:07.010252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975992f-35e0-4442-a56f-74028fabfb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:07.010721 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975992f-35e0-4442-a56f-74028fabfb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:07.011541 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975992f-35e0-4442-a56f-74028fabfb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:07.013185 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975992f-35e0-4442-a56f-74028fabfb15 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:07.025591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1408/2798] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:35:07.030919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de0def-164d-407f-ad7e-65dadb8a7827 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:07.042199 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de0def-164d-407f-ad7e-65dadb8a7827 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:07.047384 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586e62a-167c-42c3-9672-556367850041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:07.048209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586e62a-167c-42c3-9672-556367850041 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:07.048480 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586e62a-167c-42c3-9672-556367850041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:07.048756 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586e62a-167c-42c3-9672-556367850041 admin admin] PATH_INFO: `/v3/projects/1be73add26674c42b65ac6a47665f58f/users/0932e9cff4814416946463b483b237f3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:07.051388 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586e62a-167c-42c3-9672-556367850041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be73add26674c42b65ac6a47665f58f, user_id=0932e9cff4814416946463b483b237f3, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:07.054620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586e62a-167c-42c3-9672-556367850041 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:07.066473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1391/2799] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:35:07 2022] PUT /identity/v3/projects/1be73add26674c42b65ac6a47665f58f/users/0932e9cff4814416946463b483b237f3/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:35:07.078694 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ae2d4-6107-4617-80be-6267b679086e None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:07.078993 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ae2d4-6107-4617-80be-6267b679086e None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:07.079272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ae2d4-6107-4617-80be-6267b679086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:07.107138 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ef1ae2d4-6107-4617-80be-6267b679086e None None] MFA Rules not processed for user `0932e9cff4814416946463b483b237f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:07.108393 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ef1ae2d4-6107-4617-80be-6267b679086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:07.181462 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1409/2800] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:07.195303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586e62a-167c-42c3-9672-556367850041 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:07.198824 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e586e62a-167c-42c3-9672-556367850041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:07.274160 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586e62a-167c-42c3-9672-556367850041 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:07.278182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1dacb-7341-460a-a692-cad984586fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:07.278819 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1dacb-7341-460a-a692-cad984586fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:07.279098 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1dacb-7341-460a-a692-cad984586fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:07.279369 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1dacb-7341-460a-a692-cad984586fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:07.339930 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1dacb-7341-460a-a692-cad984586fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:07.341298 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1dacb-7341-460a-a692-cad984586fd6 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:07.354261 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1392/2801] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:08.863578 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ae2d4-6107-4617-80be-6267b679086e None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:08.865106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ef1ae2d4-6107-4617-80be-6267b679086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:08.878230 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ae2d4-6107-4617-80be-6267b679086e None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:08.882535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bb3dc-12b2-4c5c-aa52-6155a8cdddca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:08.883252 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bb3dc-12b2-4c5c-aa52-6155a8cdddca service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:08.883465 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bb3dc-12b2-4c5c-aa52-6155a8cdddca service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:08.883716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bb3dc-12b2-4c5c-aa52-6155a8cdddca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:08.944661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bb3dc-12b2-4c5c-aa52-6155a8cdddca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:08.946177 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bb3dc-12b2-4c5c-aa52-6155a8cdddca service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:08.955299 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1410/2802] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:09.542359 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1dacb-7341-460a-a692-cad984586fd6 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:09.551308 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1dacb-7341-460a-a692-cad984586fd6 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:09.555057 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df4138-c031-41ea-87b9-60ebcd581a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:09.555694 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4138-c031-41ea-87b9-60ebcd581a84 service cinder] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:09.555967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4138-c031-41ea-87b9-60ebcd581a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:09.556233 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4138-c031-41ea-87b9-60ebcd581a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:09.565496 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df4138-c031-41ea-87b9-60ebcd581a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:09.566878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df4138-c031-41ea-87b9-60ebcd581a84 service cinder] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:09.576662 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1393/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:11.216209 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bb3dc-12b2-4c5c-aa52-6155a8cdddca service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:11.217842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5f9bb3dc-12b2-4c5c-aa52-6155a8cdddca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:11.279282 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bb3dc-12b2-4c5c-aa52-6155a8cdddca service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:11.282894 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cee50-3873-478c-8e13-77ef46439440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:11.283546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cee50-3873-478c-8e13-77ef46439440 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:11.283823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cee50-3873-478c-8e13-77ef46439440 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:11.284093 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cee50-3873-478c-8e13-77ef46439440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:11.285976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-265cee50-3873-478c-8e13-77ef46439440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:11.365269 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cee50-3873-478c-8e13-77ef46439440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:11.366626 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cee50-3873-478c-8e13-77ef46439440 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:11.378166 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1411/2804] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:12.558115 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df4138-c031-41ea-87b9-60ebcd581a84 service cinder] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:12.568974 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df4138-c031-41ea-87b9-60ebcd581a84 service cinder] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:12.574077 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064a4ec-001e-46a1-89fa-d78c19a4381f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:12.574723 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064a4ec-001e-46a1-89fa-d78c19a4381f service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:12.574994 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064a4ec-001e-46a1-89fa-d78c19a4381f service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:12.575235 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064a4ec-001e-46a1-89fa-d78c19a4381f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:12.577481 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2064a4ec-001e-46a1-89fa-d78c19a4381f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:12.592475 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064a4ec-001e-46a1-89fa-d78c19a4381f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:12.594082 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064a4ec-001e-46a1-89fa-d78c19a4381f service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:12.605671 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1394/2805] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:16.637704 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cee50-3873-478c-8e13-77ef46439440 service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:16.706447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cee50-3873-478c-8e13-77ef46439440 service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:16.711133 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:16.712003 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:16.712281 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:16.712552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] PATH_INFO: `/v3/users/6e98a6e08f074df8a554ad1ac40d797b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:16.713805 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e98a6e08f074df8a554ad1ac40d797b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:16.715727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:16.765089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e98a6e08f074df8a554ad1ac40d797b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:16.771604 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e98a6e08f074df8a554ad1ac40d797b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:16.772279 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e98a6e08f074df8a554ad1ac40d797b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:16.781129 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e98a6e08f074df8a554ad1ac40d797b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:16.793849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e98a6e08f074df8a554ad1ac40d797b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:16.799727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1412/2806] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:35:16 2022] DELETE /identity/v3/users/6e98a6e08f074df8a554ad1ac40d797b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:16.804494 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0230bd-a618-4045-92fb-0ed049e72941 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:16.805000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0230bd-a618-4045-92fb-0ed049e72941 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:16.805000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0230bd-a618-4045-92fb-0ed049e72941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:16.823737 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-8a0230bd-a618-4045-92fb-0ed049e72941 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:16.824832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8a0230bd-a618-4045-92fb-0ed049e72941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:16.886990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1395/2807] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:16.898288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:16.900608 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:16.965366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e7054-d7dd-442a-882d-bd8b0f7cb99f admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:16.969475 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91e36-9d63-48be-a082-f014bf916a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:16.970127 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91e36-9d63-48be-a082-f014bf916a2c service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:16.970404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91e36-9d63-48be-a082-f014bf916a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:16.970661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c91e36-9d63-48be-a082-f014bf916a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:16.980853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c91e36-9d63-48be-a082-f014bf916a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:16.982356 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c91e36-9d63-48be-a082-f014bf916a2c service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:16.995146 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1413/2808] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:17.279854 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0230bd-a618-4045-92fb-0ed049e72941 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:17.281423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-8a0230bd-a618-4045-92fb-0ed049e72941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:17.305183 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0230bd-a618-4045-92fb-0ed049e72941 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:17.311370 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:17.312374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:17.312752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:17.313140 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] PATH_INFO: `/v3/projects/9d5140171718487080a1655a6da673d3` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:17.315992 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5140171718487080a1655a6da673d3)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:17.318487 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:17.378981 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5140171718487080a1655a6da673d3', 'request_id': 'req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:17.388466 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5140171718487080a1655a6da673d3', 'request_id': 'req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:17.401439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5140171718487080a1655a6da673d3', 'request_id': 'req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:17.413557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] The token cache is being invalidate because project 9d5140171718487080a1655a6da673d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:35:17.413839 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:17.414550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:17.416377 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1396/2809] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:35:17 2022] DELETE /identity/v3/projects/9d5140171718487080a1655a6da673d3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:17.420745 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91e36-9d63-48be-a082-f014bf916a2c service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:17.431133 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c91e36-9d63-48be-a082-f014bf916a2c service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:17.497255 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:17.498167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:17.498443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:17.498714 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] PATH_INFO: `/v3/users/3f3a955c480a47ebb1112d7cc77e16c3` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:17.501590 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3a955c480a47ebb1112d7cc77e16c3)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:17.504228 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:17.563939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3a955c480a47ebb1112d7cc77e16c3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:17.570571 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3a955c480a47ebb1112d7cc77e16c3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:17.571827 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3a955c480a47ebb1112d7cc77e16c3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:17.580950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3a955c480a47ebb1112d7cc77e16c3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:17.593049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3a955c480a47ebb1112d7cc77e16c3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:17.599321 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1414/2810] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:35:17 2022] DELETE /identity/v3/users/3f3a955c480a47ebb1112d7cc77e16c3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:17.898983 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:17.900507 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:17.913677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d56f9-1b0c-40a7-bf9b-97f2a53db859 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:17.977044 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:17.977938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:17.978201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:17.978479 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] PATH_INFO: `/v3/projects/18119d0f884441ecb2bd726160a78491` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:17.979712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] RBAC: Authorizing `identity:delete_project(project_id=18119d0f884441ecb2bd726160a78491)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:17.981666 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:18.030314 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18119d0f884441ecb2bd726160a78491', 'request_id': 'req-dd381988-7cc0-4b88-89b3-fb564cb5abde'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.038959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18119d0f884441ecb2bd726160a78491', 'request_id': 'req-dd381988-7cc0-4b88-89b3-fb564cb5abde'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.045811 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18119d0f884441ecb2bd726160a78491', 'request_id': 'req-dd381988-7cc0-4b88-89b3-fb564cb5abde'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.058955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] The token cache is being invalidate because project 18119d0f884441ecb2bd726160a78491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:35:18.059390 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.060397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.062579 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1397/2811] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:35:17 2022] DELETE /identity/v3/projects/18119d0f884441ecb2bd726160a78491 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:18.066627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:18.068150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:18.082317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e587aa-94da-475f-aec4-21300353278e admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:18.138555 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:18.139417 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:18.139703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:18.139974 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] PATH_INFO: `/v3/users/0932e9cff4814416946463b483b237f3` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:18.141318 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0932e9cff4814416946463b483b237f3)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:18.143297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:18.199054 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0932e9cff4814416946463b483b237f3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.205716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0932e9cff4814416946463b483b237f3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.206375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0932e9cff4814416946463b483b237f3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.215178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0932e9cff4814416946463b483b237f3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.226966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0932e9cff4814416946463b483b237f3'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.232983 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1415/2812] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:35:18 2022] DELETE /identity/v3/users/0932e9cff4814416946463b483b237f3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:18.407903 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:18.409564 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:18.422250 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd381988-7cc0-4b88-89b3-fb564cb5abde admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:18.477861 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:18.479132 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:18.479512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:18.479944 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] PATH_INFO: `/v3/users/2901d5107afb4484b98377f4f03854f6` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:18.482232 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2901d5107afb4484b98377f4f03854f6)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:18.485863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:18.515352 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:18.517403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:18.542673 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2901d5107afb4484b98377f4f03854f6'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.543350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0109c2c-888c-4e78-bf4d-03b1e8f66596 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:18.550502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2901d5107afb4484b98377f4f03854f6'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.551734 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:18.553187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:18.554053 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:18.554531 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] PATH_INFO: `/v3/projects/1be73add26674c42b65ac6a47665f58f` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:18.559492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be73add26674c42b65ac6a47665f58f)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:18.561351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:18.563644 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2901d5107afb4484b98377f4f03854f6'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.564312 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2901d5107afb4484b98377f4f03854f6'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.575504 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6e91c5b9-9471-4f78-bad0-b8ce0f0a5947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2901d5107afb4484b98377f4f03854f6'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.582374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1398/2813] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:35:18 2022] DELETE /identity/v3/users/2901d5107afb4484b98377f4f03854f6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:18.586856 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c591e-8e69-442f-a869-98697b2437be None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:18.587278 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c591e-8e69-442f-a869-98697b2437be None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:18.587550 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c591e-8e69-442f-a869-98697b2437be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:18.608169 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-925c591e-8e69-442f-a869-98697b2437be None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:18.609439 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-925c591e-8e69-442f-a869-98697b2437be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:18.652661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be73add26674c42b65ac6a47665f58f', 'request_id': 'req-74a3e135-20df-4f2e-8309-ddff175253b0'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.660032 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be73add26674c42b65ac6a47665f58f', 'request_id': 'req-74a3e135-20df-4f2e-8309-ddff175253b0'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.665741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be73add26674c42b65ac6a47665f58f', 'request_id': 'req-74a3e135-20df-4f2e-8309-ddff175253b0'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.677768 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1399/2814] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:18.683021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] The token cache is being invalidate because project 1be73add26674c42b65ac6a47665f58f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:35:18.683311 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.683968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-74a3e135-20df-4f2e-8309-ddff175253b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:18.685772 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1416/2815] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:35:18 2022] DELETE /identity/v3/projects/1be73add26674c42b65ac6a47665f58f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:18.688182 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c591e-8e69-442f-a869-98697b2437be None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:18.690240 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-925c591e-8e69-442f-a869-98697b2437be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:18.691031 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc256aa-61ea-4f42-bfa3-875def109043 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:18.691351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc256aa-61ea-4f42-bfa3-875def109043 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:18.691905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc256aa-61ea-4f42-bfa3-875def109043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:18.711433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-7dc256aa-61ea-4f42-bfa3-875def109043 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:18.712223 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-7dc256aa-61ea-4f42-bfa3-875def109043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:18.756910 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c591e-8e69-442f-a869-98697b2437be None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:18.768914 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1417/2816] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:35:18.777967 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cf4f6-5699-4fd1-9333-0e5805ed388b None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:18.778251 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cf4f6-5699-4fd1-9333-0e5805ed388b None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:18.778518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cf4f6-5699-4fd1-9333-0e5805ed388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:18.795981 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-975cf4f6-5699-4fd1-9333-0e5805ed388b None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:18.797187 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-975cf4f6-5699-4fd1-9333-0e5805ed388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:18.805094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1418/2817] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:35:18.808729 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfac21-c63c-4ca3-b358-99399cd39242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:18.809342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cf4f6-5699-4fd1-9333-0e5805ed388b None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:18.809455 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfac21-c63c-4ca3-b358-99399cd39242 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:18.809795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfac21-c63c-4ca3-b358-99399cd39242 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:18.810075 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfac21-c63c-4ca3-b358-99399cd39242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:18.813512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-d3dfac21-c63c-4ca3-b358-99399cd39242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:18.818280 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cf4f6-5699-4fd1-9333-0e5805ed388b None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:18.823549 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031af0-d579-4656-be2c-9ed28a37d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:18.824200 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031af0-d579-4656-be2c-9ed28a37d5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:18.824472 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031af0-d579-4656-be2c-9ed28a37d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:18.824741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031af0-d579-4656-be2c-9ed28a37d5f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:18.825512 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031af0-d579-4656-be2c-9ed28a37d5f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79114) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:35:18.825815 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031af0-d579-4656-be2c-9ed28a37d5f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:18.827419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031af0-d579-4656-be2c-9ed28a37d5f9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:18.829832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfac21-c63c-4ca3-b358-99399cd39242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:18.831229 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfac21-c63c-4ca3-b358-99399cd39242 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:18.839778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1419/2818] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 28 01:35:18.841933 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1400/2819] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:35:18.844013 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031af0-d579-4656-be2c-9ed28a37d5f9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:18.853925 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031af0-d579-4656-be2c-9ed28a37d5f9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:18.858950 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edbf95-0132-4a4e-b246-47a6739307de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:18.859609 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edbf95-0132-4a4e-b246-47a6739307de admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:18.859884 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edbf95-0132-4a4e-b246-47a6739307de admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:18.860155 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6edbf95-0132-4a4e-b246-47a6739307de admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:18.861099 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edbf95-0132-4a4e-b246-47a6739307de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:18.863045 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6edbf95-0132-4a4e-b246-47a6739307de admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:18.890546 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1420/2820] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:35:18 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:35:18.894938 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfac21-c63c-4ca3-b358-99399cd39242 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:18.905177 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfac21-c63c-4ca3-b358-99399cd39242 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:18.967200 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7840e-2383-48ce-ad37-2926a78ee1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:18.967877 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7840e-2383-48ce-ad37-2926a78ee1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:18.968155 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7840e-2383-48ce-ad37-2926a78ee1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:18.968427 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7840e-2383-48ce-ad37-2926a78ee1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:18.969138 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7840e-2383-48ce-ad37-2926a78ee1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:18.971084 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7840e-2383-48ce-ad37-2926a78ee1b0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:18.993262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1401/2821] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:35:18 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:35:18.997211 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edbf95-0132-4a4e-b246-47a6739307de admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.007879 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6edbf95-0132-4a4e-b246-47a6739307de admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.017676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a6131-b0d2-4907-b7fe-6689cd5ade08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.018522 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a6131-b0d2-4907-b7fe-6689cd5ade08 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.018875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a6131-b0d2-4907-b7fe-6689cd5ade08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.019217 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a6131-b0d2-4907-b7fe-6689cd5ade08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.020065 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a6131-b0d2-4907-b7fe-6689cd5ade08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.021771 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a6131-b0d2-4907-b7fe-6689cd5ade08 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.032130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1421/2822] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:19.036239 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7840e-2383-48ce-ad37-2926a78ee1b0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.046386 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7840e-2383-48ce-ad37-2926a78ee1b0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.051761 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58a67d-c93e-463c-9d9c-2465a4271610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.052516 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a67d-c93e-463c-9d9c-2465a4271610 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.052864 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a67d-c93e-463c-9d9c-2465a4271610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.053294 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58a67d-c93e-463c-9d9c-2465a4271610 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.054188 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58a67d-c93e-463c-9d9c-2465a4271610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.056205 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58a67d-c93e-463c-9d9c-2465a4271610 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.067538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1402/2823] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:19.071946 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a6131-b0d2-4907-b7fe-6689cd5ade08 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.083184 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a6131-b0d2-4907-b7fe-6689cd5ade08 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.088802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49066b-b05e-4140-bfbe-a31562ca92dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.089749 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49066b-b05e-4140-bfbe-a31562ca92dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.090025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49066b-b05e-4140-bfbe-a31562ca92dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.090294 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49066b-b05e-4140-bfbe-a31562ca92dd admin admin] PATH_INFO: `/v3/projects/176b6d42cbb248179371a35e5689cd13/users/85c206e222604ec3af519ec86371c838/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.106186 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49066b-b05e-4140-bfbe-a31562ca92dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=176b6d42cbb248179371a35e5689cd13, user_id=85c206e222604ec3af519ec86371c838, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.108869 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49066b-b05e-4140-bfbe-a31562ca92dd admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.124670 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1422/2824] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:35:19 2022] PUT /identity/v3/projects/176b6d42cbb248179371a35e5689cd13/users/85c206e222604ec3af519ec86371c838/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:19.133254 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58a67d-c93e-463c-9d9c-2465a4271610 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.135236 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-3f58a67d-c93e-463c-9d9c-2465a4271610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:19.135944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd60df1-5d93-4c0b-815c-c52fbfcbe9e6 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.136233 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd60df1-5d93-4c0b-815c-c52fbfcbe9e6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.136508 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd60df1-5d93-4c0b-815c-c52fbfcbe9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.151092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58a67d-c93e-463c-9d9c-2465a4271610 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.168262 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-1cd60df1-5d93-4c0b-815c-c52fbfcbe9e6 None None] MFA Rules not processed for user `85c206e222604ec3af519ec86371c838`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:19.169507 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1cd60df1-5d93-4c0b-815c-c52fbfcbe9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:19.212185 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.213000 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.213315 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.213589 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] PATH_INFO: `/v3/projects/fa9618e1ab194eeaa2345dcad6d8fc73` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.214799 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9618e1ab194eeaa2345dcad6d8fc73)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.218262 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.237214 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1423/2825] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:19.247801 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd60df1-5d93-4c0b-815c-c52fbfcbe9e6 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.249593 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-1cd60df1-5d93-4c0b-815c-c52fbfcbe9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:19.271409 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9618e1ab194eeaa2345dcad6d8fc73', 'request_id': 'req-03b4527f-82a0-45cf-b7c1-f5e068d0a112'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:19.280289 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9618e1ab194eeaa2345dcad6d8fc73', 'request_id': 'req-03b4527f-82a0-45cf-b7c1-f5e068d0a112'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:19.286695 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9618e1ab194eeaa2345dcad6d8fc73', 'request_id': 'req-03b4527f-82a0-45cf-b7c1-f5e068d0a112'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:19.299008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] The token cache is being invalidate because project fa9618e1ab194eeaa2345dcad6d8fc73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:35:19.299429 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:19.300392 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-03b4527f-82a0-45cf-b7c1-f5e068d0a112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:19.302071 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1403/2826] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:35:19 2022] DELETE /identity/v3/projects/fa9618e1ab194eeaa2345dcad6d8fc73 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:19.309514 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd60df1-5d93-4c0b-815c-c52fbfcbe9e6 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.310300 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58fd8-9425-4214-b4bd-0482db2367af None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.310520 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58fd8-9425-4214-b4bd-0482db2367af None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.310805 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58fd8-9425-4214-b4bd-0482db2367af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.329667 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-a3e58fd8-9425-4214-b4bd-0482db2367af None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:19.330872 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-a3e58fd8-9425-4214-b4bd-0482db2367af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:19.357463 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff87481-7dee-425e-a70d-52b0431bb8a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.358095 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff87481-7dee-425e-a70d-52b0431bb8a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.358365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff87481-7dee-425e-a70d-52b0431bb8a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.358613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff87481-7dee-425e-a70d-52b0431bb8a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.360404 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-aff87481-7dee-425e-a70d-52b0431bb8a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:19.389186 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1404/2827] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:19.397846 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afba58-e6cf-4e6d-ae3a-5a9676fe723c None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.398133 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afba58-e6cf-4e6d-ae3a-5a9676fe723c None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.398406 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afba58-e6cf-4e6d-ae3a-5a9676fe723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.417032 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff87481-7dee-425e-a70d-52b0431bb8a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.417368 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-19afba58-e6cf-4e6d-ae3a-5a9676fe723c None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:19.418306 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-19afba58-e6cf-4e6d-ae3a-5a9676fe723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:19.418508 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff87481-7dee-425e-a70d-52b0431bb8a5 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.427137 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1405/2828] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:19.428347 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1424/2829] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:35:19.431452 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afba58-e6cf-4e6d-ae3a-5a9676fe723c None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.440922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afba58-e6cf-4e6d-ae3a-5a9676fe723c None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.445849 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf236f5-6ff4-4cb8-94a0-ad2c1dfdc3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.446563 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf236f5-6ff4-4cb8-94a0-ad2c1dfdc3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.446869 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf236f5-6ff4-4cb8-94a0-ad2c1dfdc3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.447104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf236f5-6ff4-4cb8-94a0-ad2c1dfdc3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.448177 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf236f5-6ff4-4cb8-94a0-ad2c1dfdc3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:35:19.448506 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf236f5-6ff4-4cb8-94a0-ad2c1dfdc3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.450099 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf236f5-6ff4-4cb8-94a0-ad2c1dfdc3a9 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.461473 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1406/2830] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:35:19.465966 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff87481-7dee-425e-a70d-52b0431bb8a5 service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.476429 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff87481-7dee-425e-a70d-52b0431bb8a5 service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.481671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3b37c-a291-4491-8778-9a94d126a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.482312 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3b37c-a291-4491-8778-9a94d126a706 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.482560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3b37c-a291-4491-8778-9a94d126a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.482832 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3b37c-a291-4491-8778-9a94d126a706 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.483551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3b37c-a291-4491-8778-9a94d126a706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.485515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3b37c-a291-4491-8778-9a94d126a706 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.516567 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1425/2831] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:35:19 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:35:19.517778 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf236f5-6ff4-4cb8-94a0-ad2c1dfdc3a9 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.528151 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf236f5-6ff4-4cb8-94a0-ad2c1dfdc3a9 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.586941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffbcfd-6559-4937-bf2e-6dbaec0cd3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.587640 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffbcfd-6559-4937-bf2e-6dbaec0cd3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.587950 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffbcfd-6559-4937-bf2e-6dbaec0cd3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.588213 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffbcfd-6559-4937-bf2e-6dbaec0cd3c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.588922 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffbcfd-6559-4937-bf2e-6dbaec0cd3c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.590837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffbcfd-6559-4937-bf2e-6dbaec0cd3c0 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.616127 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1407/2832] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:35:19 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:35:19.617677 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3b37c-a291-4491-8778-9a94d126a706 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.629089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3b37c-a291-4491-8778-9a94d126a706 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.634090 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f7703-274c-41e9-a7ca-949f2f5d5ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.634875 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f7703-274c-41e9-a7ca-949f2f5d5ebb admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.635332 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f7703-274c-41e9-a7ca-949f2f5d5ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.635603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f7703-274c-41e9-a7ca-949f2f5d5ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.636419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f7703-274c-41e9-a7ca-949f2f5d5ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.638145 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f7703-274c-41e9-a7ca-949f2f5d5ebb admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.650212 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1426/2833] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:19.655068 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffbcfd-6559-4937-bf2e-6dbaec0cd3c0 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.667249 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffbcfd-6559-4937-bf2e-6dbaec0cd3c0 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.673883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3854c20-f9a2-469f-aa11-85f840a8bf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.674716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3854c20-f9a2-469f-aa11-85f840a8bf39 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.675041 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3854c20-f9a2-469f-aa11-85f840a8bf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.675384 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3854c20-f9a2-469f-aa11-85f840a8bf39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.676296 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3854c20-f9a2-469f-aa11-85f840a8bf39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.678179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3854c20-f9a2-469f-aa11-85f840a8bf39 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.690580 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1408/2834] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:19.694594 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f7703-274c-41e9-a7ca-949f2f5d5ebb admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.706103 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f7703-274c-41e9-a7ca-949f2f5d5ebb admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.712720 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770ca74-e1ca-4483-a700-cf7348e8e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.713676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770ca74-e1ca-4483-a700-cf7348e8e371 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.713957 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770ca74-e1ca-4483-a700-cf7348e8e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.714235 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770ca74-e1ca-4483-a700-cf7348e8e371 admin admin] PATH_INFO: `/v3/projects/49054bd529dd4f6da0310f7fe1ef8f58/users/9af2b19a4b09402b9fc4a945b3c646ea/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.729375 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770ca74-e1ca-4483-a700-cf7348e8e371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49054bd529dd4f6da0310f7fe1ef8f58, user_id=9af2b19a4b09402b9fc4a945b3c646ea, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.732081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770ca74-e1ca-4483-a700-cf7348e8e371 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.746191 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1427/2835] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:35:19 2022] PUT /identity/v3/projects/49054bd529dd4f6da0310f7fe1ef8f58/users/9af2b19a4b09402b9fc4a945b3c646ea/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:19.752034 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26583a2-db34-4bbe-a814-bad872171689 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.752322 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26583a2-db34-4bbe-a814-bad872171689 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.752621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26583a2-db34-4bbe-a814-bad872171689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.772397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b26583a2-db34-4bbe-a814-bad872171689 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:19.773712 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b26583a2-db34-4bbe-a814-bad872171689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:19.836659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1409/2836] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:35:19.846706 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770ca74-e1ca-4483-a700-cf7348e8e371 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:19.848492 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-9770ca74-e1ca-4483-a700-cf7348e8e371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:19.922627 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770ca74-e1ca-4483-a700-cf7348e8e371 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:19.926762 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ed035-d2ff-4d1f-927a-0449c5512362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:19.927411 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ed035-d2ff-4d1f-927a-0449c5512362 service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:19.927687 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ed035-d2ff-4d1f-927a-0449c5512362 service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:19.927973 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ed035-d2ff-4d1f-927a-0449c5512362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:19.937737 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ed035-d2ff-4d1f-927a-0449c5512362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:19.939178 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ed035-d2ff-4d1f-927a-0449c5512362 service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:19.949409 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1428/2837] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:21.981472 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26583a2-db34-4bbe-a814-bad872171689 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:21.983057 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b26583a2-db34-4bbe-a814-bad872171689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:21.999883 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26583a2-db34-4bbe-a814-bad872171689 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:22.004913 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:22.005837 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:22.006119 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:22.006394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] PATH_INFO: `/v3/users/85c206e222604ec3af519ec86371c838` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:22.007709 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c206e222604ec3af519ec86371c838)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:22.009835 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:22.076685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c206e222604ec3af519ec86371c838'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:22.084754 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c206e222604ec3af519ec86371c838'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:22.100407 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c206e222604ec3af519ec86371c838'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:22.101327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c206e222604ec3af519ec86371c838'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:22.110646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c206e222604ec3af519ec86371c838'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:22.118033 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1410/2838] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:35:21 2022] DELETE /identity/v3/users/85c206e222604ec3af519ec86371c838 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:22.122774 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7701c8-030b-4c30-a79f-69eb9dab1b6f None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:22.123272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7701c8-030b-4c30-a79f-69eb9dab1b6f None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:22.123368 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7701c8-030b-4c30-a79f-69eb9dab1b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:22.142060 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ea7701c8-030b-4c30-a79f-69eb9dab1b6f None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:22.143597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ea7701c8-030b-4c30-a79f-69eb9dab1b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:22.213509 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1429/2839] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:22.223345 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:22.224947 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:22.353157 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d072c-79ee-4566-854f-21beae0ddfc5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:22.357179 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800059f9-08c2-45de-be4b-a4ae723f7d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:22.357886 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800059f9-08c2-45de-be4b-a4ae723f7d1d service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:22.358162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800059f9-08c2-45de-be4b-a4ae723f7d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:22.358423 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800059f9-08c2-45de-be4b-a4ae723f7d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:22.371984 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800059f9-08c2-45de-be4b-a4ae723f7d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:22.373485 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800059f9-08c2-45de-be4b-a4ae723f7d1d service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:22.384782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1411/2840] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:23.256373 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7701c8-030b-4c30-a79f-69eb9dab1b6f None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:23.257874 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ea7701c8-030b-4c30-a79f-69eb9dab1b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:23.271671 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7701c8-030b-4c30-a79f-69eb9dab1b6f None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:23.277917 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:23.279092 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:23.279551 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:23.279971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] PATH_INFO: `/v3/projects/176b6d42cbb248179371a35e5689cd13` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:23.281503 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] RBAC: Authorizing `identity:delete_project(project_id=176b6d42cbb248179371a35e5689cd13)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:23.283673 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:23.342460 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176b6d42cbb248179371a35e5689cd13', 'request_id': 'req-62476fdf-47ed-4749-ab67-a92fe904795e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:23.349485 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176b6d42cbb248179371a35e5689cd13', 'request_id': 'req-62476fdf-47ed-4749-ab67-a92fe904795e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:23.355766 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176b6d42cbb248179371a35e5689cd13', 'request_id': 'req-62476fdf-47ed-4749-ab67-a92fe904795e'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:23.376130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] The token cache is being invalidate because project 176b6d42cbb248179371a35e5689cd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:35:23.377419 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:23.378309 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-62476fdf-47ed-4749-ab67-a92fe904795e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:35:23.380853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1430/2841] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:35:23 2022] DELETE /identity/v3/projects/176b6d42cbb248179371a35e5689cd13 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:23.386879 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9aa3e-f9eb-4fac-868f-2e3a13734739 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:23.387349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9aa3e-f9eb-4fac-868f-2e3a13734739 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:23.387448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9aa3e-f9eb-4fac-868f-2e3a13734739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:23.410959 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-07c9aa3e-f9eb-4fac-868f-2e3a13734739 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:23.412733 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-07c9aa3e-f9eb-4fac-868f-2e3a13734739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:23.504052 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1412/2842] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:23.512430 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8f6be-4427-454d-b806-608090e61fc6 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:23.512718 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8f6be-4427-454d-b806-608090e61fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:23.513193 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8f6be-4427-454d-b806-608090e61fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:23.533517 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-19c8f6be-4427-454d-b806-608090e61fc6 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:23.535971 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-19c8f6be-4427-454d-b806-608090e61fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:23.547124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1431/2843] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 28 01:35:23.552292 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9aa3e-f9eb-4fac-868f-2e3a13734739 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:23.565358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9aa3e-f9eb-4fac-868f-2e3a13734739 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:23.571143 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7b8e1-df61-4351-92c1-ec38fed0bad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:23.572025 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b8e1-df61-4351-92c1-ec38fed0bad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:23.572312 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b8e1-df61-4351-92c1-ec38fed0bad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:23.572595 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7b8e1-df61-4351-92c1-ec38fed0bad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:23.573688 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7b8e1-df61-4351-92c1-ec38fed0bad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79113) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 28 01:35:23.573993 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7b8e1-df61-4351-92c1-ec38fed0bad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:23.576327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7b8e1-df61-4351-92c1-ec38fed0bad5 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:23.599978 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8f6be-4427-454d-b806-608090e61fc6 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:23.610914 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1413/2844] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Jan 28 01:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 28 01:35:23.615000 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8f6be-4427-454d-b806-608090e61fc6 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:23.621208 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e8b0-17fe-4a05-8251-95b9ae94513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:23.622380 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e8b0-17fe-4a05-8251-95b9ae94513b admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:23.622976 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e8b0-17fe-4a05-8251-95b9ae94513b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:23.623650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e8b0-17fe-4a05-8251-95b9ae94513b admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:23.625220 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e8b0-17fe-4a05-8251-95b9ae94513b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:23.629130 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e8b0-17fe-4a05-8251-95b9ae94513b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:23.700831 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1432/2845] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:35:23 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 28 01:35:23.704965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7b8e1-df61-4351-92c1-ec38fed0bad5 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:23.724326 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7b8e1-df61-4351-92c1-ec38fed0bad5 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:23.815808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cd79d-adc3-48b2-8f16-5bbc6cc9a13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:23.816925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd79d-adc3-48b2-8f16-5bbc6cc9a13c admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:23.817518 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd79d-adc3-48b2-8f16-5bbc6cc9a13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:23.818058 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd79d-adc3-48b2-8f16-5bbc6cc9a13c admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:23.818991 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cd79d-adc3-48b2-8f16-5bbc6cc9a13c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:23.821327 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cd79d-adc3-48b2-8f16-5bbc6cc9a13c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:23.848227 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1414/2846] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:35:23 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:35:23.852231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e8b0-17fe-4a05-8251-95b9ae94513b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:23.863188 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e8b0-17fe-4a05-8251-95b9ae94513b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:23.868300 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9ea0d-e23e-4740-aef1-8fe1e697e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:23.869260 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9ea0d-e23e-4740-aef1-8fe1e697e266 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:23.869553 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9ea0d-e23e-4740-aef1-8fe1e697e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:23.869830 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9ea0d-e23e-4740-aef1-8fe1e697e266 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:23.870610 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9ea0d-e23e-4740-aef1-8fe1e697e266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:23.872219 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9ea0d-e23e-4740-aef1-8fe1e697e266 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:23.883411 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1433/2847] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:23.888134 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cd79d-adc3-48b2-8f16-5bbc6cc9a13c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:23.908719 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cd79d-adc3-48b2-8f16-5bbc6cc9a13c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:23.915925 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2d16d-2c08-48a5-ba14-fa567b78785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:23.916721 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2d16d-2c08-48a5-ba14-fa567b78785d admin admin] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:23.917056 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2d16d-2c08-48a5-ba14-fa567b78785d admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:23.917512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2d16d-2c08-48a5-ba14-fa567b78785d admin admin] PATH_INFO: `/v3/roles` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:23.918349 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2d16d-2c08-48a5-ba14-fa567b78785d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:23.920055 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2d16d-2c08-48a5-ba14-fa567b78785d admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:23.931512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1415/2848] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:35:23.935790 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9ea0d-e23e-4740-aef1-8fe1e697e266 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:23.945888 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9ea0d-e23e-4740-aef1-8fe1e697e266 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:23.950849 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc27054-ef06-4b9b-85ab-18bd95f0ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:23.951741 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27054-ef06-4b9b-85ab-18bd95f0ea22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:23.952016 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27054-ef06-4b9b-85ab-18bd95f0ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:23.952286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc27054-ef06-4b9b-85ab-18bd95f0ea22 admin admin] PATH_INFO: `/v3/projects/119565454b984fdb9d1b9865c15004bf/users/2203070072fd4209b4441a68ee7be516/roles/726ccf812eba475187c3df7288e1d46b` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:23.982708 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc27054-ef06-4b9b-85ab-18bd95f0ea22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119565454b984fdb9d1b9865c15004bf, user_id=2203070072fd4209b4441a68ee7be516, role_id=726ccf812eba475187c3df7288e1d46b)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:23.985629 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc27054-ef06-4b9b-85ab-18bd95f0ea22 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:24.002443 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1434/2849] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:35:23 2022] PUT /identity/v3/projects/119565454b984fdb9d1b9865c15004bf/users/2203070072fd4209b4441a68ee7be516/roles/726ccf812eba475187c3df7288e1d46b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:24.068752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a176fc-69d6-4db4-b68d-989beb451981 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:24.069092 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a176fc-69d6-4db4-b68d-989beb451981 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:24.069502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a176fc-69d6-4db4-b68d-989beb451981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:24.103736 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-b4a176fc-69d6-4db4-b68d-989beb451981 None None] MFA Rules not processed for user `2203070072fd4209b4441a68ee7be516`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:24.105153 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b4a176fc-69d6-4db4-b68d-989beb451981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:24.187948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1416/2850] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:24.199597 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc27054-ef06-4b9b-85ab-18bd95f0ea22 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:24.201889 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-abc27054-ef06-4b9b-85ab-18bd95f0ea22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:24.269955 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc27054-ef06-4b9b-85ab-18bd95f0ea22 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:24.274011 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f24d3-ce30-4c0b-bf70-df5ba63693c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a19c46c2ecd746d7a6e10c09d706a675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:24.274944 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f24d3-ce30-4c0b-bf70-df5ba63693c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:24.275411 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f24d3-ce30-4c0b-bf70-df5ba63693c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:24.275679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f24d3-ce30-4c0b-bf70-df5ba63693c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:24.287557 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f24d3-ce30-4c0b-bf70-df5ba63693c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:24.289151 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f24d3-ce30-4c0b-bf70-df5ba63693c7 service cinder] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:24.305182 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1435/2851] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:24.535510 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e3006-5c28-4619-ae98-8783aa6b5549 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:24.536063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e3006-5c28-4619-ae98-8783aa6b5549 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:24.536063 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e3006-5c28-4619-ae98-8783aa6b5549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:24.580665 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-ea2e3006-5c28-4619-ae98-8783aa6b5549 None None] MFA Rules not processed for user `9af2b19a4b09402b9fc4a945b3c646ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:24.581955 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-ea2e3006-5c28-4619-ae98-8783aa6b5549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:24.677538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1417/2852] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:24.681719 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f24d3-ce30-4c0b-bf70-df5ba63693c7 service cinder] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:24.683215 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-912f24d3-ce30-4c0b-bf70-df5ba63693c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:24.764027 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f24d3-ce30-4c0b-bf70-df5ba63693c7 service cinder] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:24.769595 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdcbc2-431b-4044-b51e-8ea362b0dbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:24.770286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdcbc2-431b-4044-b51e-8ea362b0dbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:24.770568 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdcbc2-431b-4044-b51e-8ea362b0dbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:24.771021 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdcbc2-431b-4044-b51e-8ea362b0dbc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:24.771759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdcbc2-431b-4044-b51e-8ea362b0dbc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:24.774205 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdcbc2-431b-4044-b51e-8ea362b0dbc8 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:24.818528 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1436/2853] 10.222.0.16 () {60 vars in 1152 bytes} [Fri Jan 28 01:35:24 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:35:24.823717 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e3006-5c28-4619-ae98-8783aa6b5549 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:24.839325 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e3006-5c28-4619-ae98-8783aa6b5549 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:24.917990 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91009af6-bf1e-413f-919f-4ddd2b76955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:24.918403 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91009af6-bf1e-413f-919f-4ddd2b76955f admin admin] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:24.918670 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91009af6-bf1e-413f-919f-4ddd2b76955f admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:24.918953 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91009af6-bf1e-413f-919f-4ddd2b76955f admin admin] PATH_INFO: `/v3/users` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:24.919675 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91009af6-bf1e-413f-919f-4ddd2b76955f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:24.921668 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91009af6-bf1e-413f-919f-4ddd2b76955f admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:24.964159 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1418/2854] 10.222.0.16 () {60 vars in 1143 bytes} [Fri Jan 28 01:35:24 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 28 01:35:24.968407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdcbc2-431b-4044-b51e-8ea362b0dbc8 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:24.989071 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdcbc2-431b-4044-b51e-8ea362b0dbc8 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:24.998764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4443b-3ebc-4bfe-9bb2-392f553a8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:24.998764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4443b-3ebc-4bfe-9bb2-392f553a8212 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:24.998764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4443b-3ebc-4bfe-9bb2-392f553a8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:24.998764 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4443b-3ebc-4bfe-9bb2-392f553a8212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:24.999270 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4443b-3ebc-4bfe-9bb2-392f553a8212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:24.999952 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4443b-3ebc-4bfe-9bb2-392f553a8212 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:25.013904 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1437/2855] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 28 01:35:25.019216 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91009af6-bf1e-413f-919f-4ddd2b76955f admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:25.030601 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91009af6-bf1e-413f-919f-4ddd2b76955f admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:25.036072 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125fced-8bde-4d96-9aff-75ee0d2e1642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:25.036999 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125fced-8bde-4d96-9aff-75ee0d2e1642 admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:25.037313 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125fced-8bde-4d96-9aff-75ee0d2e1642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:25.037591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125fced-8bde-4d96-9aff-75ee0d2e1642 admin admin] PATH_INFO: `/v3/projects/f769158b372f49aeba3988cad6693727/users/7d85b17c8c7548cc9f8706c63ee0e907/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:25.056988 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125fced-8bde-4d96-9aff-75ee0d2e1642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f769158b372f49aeba3988cad6693727, user_id=7d85b17c8c7548cc9f8706c63ee0e907, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:25.061042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125fced-8bde-4d96-9aff-75ee0d2e1642 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:25.085008 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1419/2856] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:35:25 2022] PUT /identity/v3/projects/f769158b372f49aeba3988cad6693727/users/7d85b17c8c7548cc9f8706c63ee0e907/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:25.086368 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4443b-3ebc-4bfe-9bb2-392f553a8212 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:25.099137 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4443b-3ebc-4bfe-9bb2-392f553a8212 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:25.176499 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b628e1-088f-48a1-b6a1-61e568ccc538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:25.177194 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b628e1-088f-48a1-b6a1-61e568ccc538 admin admin] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:25.177505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b628e1-088f-48a1-b6a1-61e568ccc538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:25.177924 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b628e1-088f-48a1-b6a1-61e568ccc538 admin admin] PATH_INFO: `/v3/roles` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:25.178697 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b628e1-088f-48a1-b6a1-61e568ccc538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:25.180342 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b628e1-088f-48a1-b6a1-61e568ccc538 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:25.194372 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1438/2857] 10.222.0.16 () {58 vars in 1121 bytes} [Fri Jan 28 01:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 28 01:35:25.198585 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125fced-8bde-4d96-9aff-75ee0d2e1642 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:25.213348 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125fced-8bde-4d96-9aff-75ee0d2e1642 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:25.218692 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd9648-95a6-42c5-92d7-8535f79be1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:25.220255 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd9648-95a6-42c5-92d7-8535f79be1de admin admin] REQUEST_METHOD: `PUT` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:25.220603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd9648-95a6-42c5-92d7-8535f79be1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:25.221635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd9648-95a6-42c5-92d7-8535f79be1de admin admin] PATH_INFO: `/v3/projects/f769158b372f49aeba3988cad6693727/users/7d85b17c8c7548cc9f8706c63ee0e907/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:25.223845 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd9648-95a6-42c5-92d7-8535f79be1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f769158b372f49aeba3988cad6693727, user_id=7d85b17c8c7548cc9f8706c63ee0e907, role_id=a7fb3ff7212d48cea4d02eff9a6cdb8e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:25.227146 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd9648-95a6-42c5-92d7-8535f79be1de admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:25.239343 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1420/2858] 10.222.0.16 () {60 vars in 1482 bytes} [Fri Jan 28 01:35:25 2022] PUT /identity/v3/projects/f769158b372f49aeba3988cad6693727/users/7d85b17c8c7548cc9f8706c63ee0e907/roles/a7fb3ff7212d48cea4d02eff9a6cdb8e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:35:30.168937 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110af5c-eb64-4478-9adf-b95cef35da60 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:30.169532 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110af5c-eb64-4478-9adf-b95cef35da60 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:30.169823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110af5c-eb64-4478-9adf-b95cef35da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:30.201221 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-e110af5c-eb64-4478-9adf-b95cef35da60 None None] MFA Rules not processed for user `7d85b17c8c7548cc9f8706c63ee0e907`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:30.202823 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-e110af5c-eb64-4478-9adf-b95cef35da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:30.306452 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1439/2859] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:30.319309 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd9648-95a6-42c5-92d7-8535f79be1de admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:30.321174 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-f9fd9648-95a6-42c5-92d7-8535f79be1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:30.395104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd9648-95a6-42c5-92d7-8535f79be1de admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:30.398752 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c8dfd-633a-4c00-bc34-fa204bc3d203 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36ec2950259d4ed0925d7a19a6217af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:30.399397 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c8dfd-633a-4c00-bc34-fa204bc3d203 service glance] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:30.399951 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c8dfd-633a-4c00-bc34-fa204bc3d203 service glance] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:30.400311 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c8dfd-633a-4c00-bc34-fa204bc3d203 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:30.465126 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c8dfd-633a-4c00-bc34-fa204bc3d203 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:30.467271 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c8dfd-633a-4c00-bc34-fa204bc3d203 service glance] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:30.481208 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1421/2860] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:30.616144 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ac19-001c-459d-afda-05d41a0171ed None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:30.616784 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ac19-001c-459d-afda-05d41a0171ed None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:30.617302 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ac19-001c-459d-afda-05d41a0171ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:30.639505 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-45e5ac19-001c-459d-afda-05d41a0171ed None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:30.640786 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-45e5ac19-001c-459d-afda-05d41a0171ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:30.713657 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1440/2861] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:35:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:30.737057 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c8dfd-633a-4c00-bc34-fa204bc3d203 service glance] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:30.738621 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-bb3c8dfd-633a-4c00-bc34-fa204bc3d203 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:30.812776 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c8dfd-633a-4c00-bc34-fa204bc3d203 service glance] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:30.822096 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e39a1-94a7-48a9-90b3-d4f94c7160b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:30.824129 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e39a1-94a7-48a9-90b3-d4f94c7160b0 service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:30.824578 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e39a1-94a7-48a9-90b3-d4f94c7160b0 service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:30.825032 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e39a1-94a7-48a9-90b3-d4f94c7160b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:30.837709 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e39a1-94a7-48a9-90b3-d4f94c7160b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:30.839918 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e39a1-94a7-48a9-90b3-d4f94c7160b0 service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:30.849144 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1422/2862] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:35:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 28 01:35:39.499461 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5ac19-001c-459d-afda-05d41a0171ed None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:39.500896 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-45e5ac19-001c-459d-afda-05d41a0171ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:39.563940 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5ac19-001c-459d-afda-05d41a0171ed None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:39.567676 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6409ae-be07-456c-8d00-c464d78179ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:39.568325 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6409ae-be07-456c-8d00-c464d78179ad service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:39.568603 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6409ae-be07-456c-8d00-c464d78179ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:39.570811 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6409ae-be07-456c-8d00-c464d78179ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:39.573089 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-6e6409ae-be07-456c-8d00-c464d78179ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:39.583413 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6409ae-be07-456c-8d00-c464d78179ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:39.584866 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6409ae-be07-456c-8d00-c464d78179ad service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:39.595216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1441/2863] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:40.104380 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b511b33-d503-42a1-8a9b-6af0de182abb None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:40.104916 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b511b33-d503-42a1-8a9b-6af0de182abb None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:40.105104 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b511b33-d503-42a1-8a9b-6af0de182abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:40.124559 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-4b511b33-d503-42a1-8a9b-6af0de182abb None None] MFA Rules not processed for user `9af2b19a4b09402b9fc4a945b3c646ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:40.125821 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4b511b33-d503-42a1-8a9b-6af0de182abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:40.134074 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1423/2864] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:42.683142 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cae0d-e3d3-4ab1-950e-dfef6c7ceefb None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:42.683727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cae0d-e3d3-4ab1-950e-dfef6c7ceefb None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:42.683997 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cae0d-e3d3-4ab1-950e-dfef6c7ceefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:42.703756 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b03cae0d-e3d3-4ab1-950e-dfef6c7ceefb None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:42.705167 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b03cae0d-e3d3-4ab1-950e-dfef6c7ceefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:42.712907 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1442/2865] 10.222.0.16 () {58 vars in 1009 bytes} [Fri Jan 28 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:42.728191 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b511b33-d503-42a1-8a9b-6af0de182abb None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:42.760295 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b511b33-d503-42a1-8a9b-6af0de182abb None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:42.768489 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ee29e-fb02-4522-8172-c2b7f19a5fbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:42.769818 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ee29e-fb02-4522-8172-c2b7f19a5fbc service swift] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:42.770209 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ee29e-fb02-4522-8172-c2b7f19a5fbc service swift] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:42.770716 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ee29e-fb02-4522-8172-c2b7f19a5fbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:42.783310 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ee29e-fb02-4522-8172-c2b7f19a5fbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:42.784948 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ee29e-fb02-4522-8172-c2b7f19a5fbc service swift] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:42.793979 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1424/2866] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:35:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:35:55.616105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cae0d-e3d3-4ab1-950e-dfef6c7ceefb None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:55.619070 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b03cae0d-e3d3-4ab1-950e-dfef6c7ceefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:55.760518 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cae0d-e3d3-4ab1-950e-dfef6c7ceefb None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:55.766861 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a18d3-75f3-46c6-add4-57a20aef562c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:55.768592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a18d3-75f3-46c6-add4-57a20aef562c service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:55.768592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a18d3-75f3-46c6-add4-57a20aef562c service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:55.768592 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a18d3-75f3-46c6-add4-57a20aef562c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:55.770310 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d63a18d3-75f3-46c6-add4-57a20aef562c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:55.784742 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a18d3-75f3-46c6-add4-57a20aef562c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:55.787272 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a18d3-75f3-46c6-add4-57a20aef562c service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:55.800437 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1443/2867] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:35:56.799744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db5ba7-80b4-4fd3-9ac5-ffd287875966 None None] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:56.800538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db5ba7-80b4-4fd3-9ac5-ffd287875966 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:56.800538 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db5ba7-80b4-4fd3-9ac5-ffd287875966 None None] PATH_INFO: `/` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:56.802451 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1425/2868] 10.222.0.16 () {54 vars in 921 bytes} [Fri Jan 28 01:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 28 01:35:56.809814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b79b1-88bf-4513-918b-23f30ced30a4 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:56.810802 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b79b1-88bf-4513-918b-23f30ced30a4 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:56.811072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b79b1-88bf-4513-918b-23f30ced30a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:56.869118 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-ed5b79b1-88bf-4513-918b-23f30ced30a4 None None] MFA Rules not processed for user `84470027e2824dc3a4b735d086de1300`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:35:56.870876 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ed5b79b1-88bf-4513-918b-23f30ced30a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:56.878094 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1444/2869] 10.222.0.16 () {58 vars in 1018 bytes} [Fri Jan 28 01:35:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:35:56.892222 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db5ba7-80b4-4fd3-9ac5-ffd287875966 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:56.894448 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-b2db5ba7-80b4-4fd3-9ac5-ffd287875966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:56.908899 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db5ba7-80b4-4fd3-9ac5-ffd287875966 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:56.912940 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c7f5-febb-43e2-a3d8-82987a5fa9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:56.913637 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c7f5-febb-43e2-a3d8-82987a5fa9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:56.913907 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c7f5-febb-43e2-a3d8-82987a5fa9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:56.914204 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c7f5-febb-43e2-a3d8-82987a5fa9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:56.924237 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25c7f5-febb-43e2-a3d8-82987a5fa9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:56.925892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25c7f5-febb-43e2-a3d8-82987a5fa9c2 service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:56.936967 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1426/2870] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:35:57.057618 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b79b1-88bf-4513-918b-23f30ced30a4 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:35:57.059189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-ed5b79b1-88bf-4513-918b-23f30ced30a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:57.162770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b79b1-88bf-4513-918b-23f30ced30a4 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:35:57.168552 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749ee22-59d6-47e0-ba88-7e6e812d600b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac3e041554a4439bfa91520e52fbd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:35:57.169254 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749ee22-59d6-47e0-ba88-7e6e812d600b service placement] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:35:57.169533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749ee22-59d6-47e0-ba88-7e6e812d600b service placement] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:35:57.169800 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749ee22-59d6-47e0-ba88-7e6e812d600b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:35:57.171691 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-c749ee22-59d6-47e0-ba88-7e6e812d600b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:35:57.184047 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749ee22-59d6-47e0-ba88-7e6e812d600b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:35:57.186351 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749ee22-59d6-47e0-ba88-7e6e812d600b service placement] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:35:57.198403 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1445/2871] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:35:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:36:03.894004 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c7f5-febb-43e2-a3d8-82987a5fa9c2 service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:36:03.985420 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c7f5-febb-43e2-a3d8-82987a5fa9c2 service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:36:03.989935 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:36:03.990832 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:03.991113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:03.991394 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] PATH_INFO: `/v3/users/2203070072fd4209b4441a68ee7be516` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:03.995331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2203070072fd4209b4441a68ee7be516)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:36:03.998751 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:36:04.078827 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2203070072fd4209b4441a68ee7be516'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:04.086964 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2203070072fd4209b4441a68ee7be516'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:04.101167 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2203070072fd4209b4441a68ee7be516'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:04.102040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2203070072fd4209b4441a68ee7be516'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:04.111374 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2203070072fd4209b4441a68ee7be516'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:04.118382 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1427/2872] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:36:03 2022] DELETE /identity/v3/users/2203070072fd4209b4441a68ee7be516 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:36:04.127560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbc154-86a7-4b33-a9bd-d376da38c5f2 None None] REQUEST_METHOD: `POST` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:04.129297 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbc154-86a7-4b33-a9bd-d376da38c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:04.130087 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbc154-86a7-4b33-a9bd-d376da38c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:04.156727 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.auth.core [None req-b6bbc154-86a7-4b33-a9bd-d376da38c5f2 None None] MFA Rules not processed for user `16dd35c2d4174b5ab9f9b2bf626a2af7`. Rule list: `[]` (Enabled: `True`). {{(pid=79114) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:36:04.157899 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b6bbc154-86a7-4b33-a9bd-d376da38c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:04.234716 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1446/2873] 10.222.0.16 () {58 vars in 957 bytes} [Fri Jan 28 01:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:36:04.245726 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:36:04.247633 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:04.313267 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95d557-b819-48c6-9401-1180215b366b admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:36:04.317803 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0e26a-17a2-4329-bea0-cbc21ce3f70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:36:04.318125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0e26a-17a2-4329-bea0-cbc21ce3f70a service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:04.318125 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0e26a-17a2-4329-bea0-cbc21ce3f70a service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:04.318436 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0e26a-17a2-4329-bea0-cbc21ce3f70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:04.329018 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0e26a-17a2-4329-bea0-cbc21ce3f70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:36:04.330511 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0e26a-17a2-4329-bea0-cbc21ce3f70a service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:36:04.341176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1428/2874] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:36:04.747591 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbc154-86a7-4b33-a9bd-d376da38c5f2 None None] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:36:04.749189 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b6bbc154-86a7-4b33-a9bd-d376da38c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:04.762545 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbc154-86a7-4b33-a9bd-d376da38c5f2 None None] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:36:04.768338 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:36:04.769334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:04.769646 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:04.769982 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] PATH_INFO: `/v3/projects/119565454b984fdb9d1b9865c15004bf` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:04.771447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119565454b984fdb9d1b9865c15004bf)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:36:04.773703 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:36:04.837880 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119565454b984fdb9d1b9865c15004bf', 'request_id': 'req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:04.845977 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119565454b984fdb9d1b9865c15004bf', 'request_id': 'req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:04.851842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119565454b984fdb9d1b9865c15004bf', 'request_id': 'req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:04.887026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] The token cache is being invalidate because project 119565454b984fdb9d1b9865c15004bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:36:04.887026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:04.887026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:04.887026 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1447/2875] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:36:04 2022] DELETE /identity/v3/projects/119565454b984fdb9d1b9865c15004bf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:36:09.030401 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0e26a-17a2-4329-bea0-cbc21ce3f70a service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:36:09.031808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-88d0e26a-17a2-4329-bea0-cbc21ce3f70a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:09.043176 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0e26a-17a2-4329-bea0-cbc21ce3f70a service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:36:09.096353 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681a6b7-d2c9-4072-a14c-ae205cee01eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:36:09.097107 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681a6b7-d2c9-4072-a14c-ae205cee01eb service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:09.097533 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681a6b7-d2c9-4072-a14c-ae205cee01eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:09.097894 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681a6b7-d2c9-4072-a14c-ae205cee01eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:09.100191 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4681a6b7-d2c9-4072-a14c-ae205cee01eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:09.164206 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681a6b7-d2c9-4072-a14c-ae205cee01eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:36:09.165947 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681a6b7-d2c9-4072-a14c-ae205cee01eb service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:36:09.175822 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1429/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 28 01:36:09.526350 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:36:09.527926 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:09.621156 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e81fe0-c1a1-4750-b47c-e7b896d1d9e9 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:36:09.629135 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13934e28-77a3-434d-b6c8-f768f089191b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:36:09.630035 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934e28-77a3-434d-b6c8-f768f089191b service nova] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:09.630402 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934e28-77a3-434d-b6c8-f768f089191b service nova] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:09.630791 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13934e28-77a3-434d-b6c8-f768f089191b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:09.632698 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-13934e28-77a3-434d-b6c8-f768f089191b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:09.645483 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13934e28-77a3-434d-b6c8-f768f089191b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:36:09.647105 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13934e28-77a3-434d-b6c8-f768f089191b service nova] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:36:09.657753 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1448/2877] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:36:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:36:14.725882 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681a6b7-d2c9-4072-a14c-ae205cee01eb service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:36:14.728591 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-4681a6b7-d2c9-4072-a14c-ae205cee01eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:14.741172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681a6b7-d2c9-4072-a14c-ae205cee01eb service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:36:14.753744 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ef7e7-09da-4996-9dbb-4b8855efd2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:36:14.755245 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ef7e7-09da-4996-9dbb-4b8855efd2bc service neutron] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:14.755545 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ef7e7-09da-4996-9dbb-4b8855efd2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:14.755808 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ef7e7-09da-4996-9dbb-4b8855efd2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:14.758022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9f8ef7e7-09da-4996-9dbb-4b8855efd2bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:14.823486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ef7e7-09da-4996-9dbb-4b8855efd2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:36:14.825151 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ef7e7-09da-4996-9dbb-4b8855efd2bc service neutron] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:36:14.839042 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1430/2878] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:36:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:36:17.347009 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13934e28-77a3-434d-b6c8-f768f089191b service nova] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:36:17.350928 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-13934e28-77a3-434d-b6c8-f768f089191b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:17.368341 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13934e28-77a3-434d-b6c8-f768f089191b service nova] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:36:17.373368 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:36:17.374334 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:17.374684 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:17.374964 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] PATH_INFO: `/v3/users/6b11396acc67415abb08ddddf5680df8` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:17.376197 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b11396acc67415abb08ddddf5680df8)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:36:17.378307 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:36:17.429520 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b11396acc67415abb08ddddf5680df8'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:17.436447 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b11396acc67415abb08ddddf5680df8'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:17.437148 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b11396acc67415abb08ddddf5680df8'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:17.447216 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b11396acc67415abb08ddddf5680df8'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:17.460905 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b11396acc67415abb08ddddf5680df8'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:17.467029 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1449/2879] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:36:17 2022] DELETE /identity/v3/users/6b11396acc67415abb08ddddf5680df8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:36:17.694152 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ef7e7-09da-4996-9dbb-4b8855efd2bc service neutron] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:36:17.728612 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ef7e7-09da-4996-9dbb-4b8855efd2bc service neutron] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:36:17.838303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:36:17.839366 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:17.841672 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:17.842061 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] PATH_INFO: `/v3/projects/12da7c52708b49e8827fb30ea43f8e4d` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:17.843674 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=12da7c52708b49e8827fb30ea43f8e4d)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:36:17.845795 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:36:17.926495 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12da7c52708b49e8827fb30ea43f8e4d', 'request_id': 'req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:17.940486 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12da7c52708b49e8827fb30ea43f8e4d', 'request_id': 'req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:17.952474 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12da7c52708b49e8827fb30ea43f8e4d', 'request_id': 'req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:17.966503 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] The token cache is being invalidate because project 12da7c52708b49e8827fb30ea43f8e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:36:17.966939 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:17.967685 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:17.969718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1431/2880] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:36:17 2022] DELETE /identity/v3/projects/12da7c52708b49e8827fb30ea43f8e4d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:36:17.974803 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:36:17.976572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:17.997762 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac38825-f7b2-45e8-9998-c028e16494a1 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:36:18.064632 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:36:18.066078 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:18.066576 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:18.067471 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] PATH_INFO: `/v3/users/c803c9435431420793f121bf7a7f0376` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:18.068886 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c803c9435431420793f121bf7a7f0376)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:36:18.071276 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:36:18.141845 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c803c9435431420793f121bf7a7f0376'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:18.163017 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c803c9435431420793f121bf7a7f0376'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:18.163770 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c803c9435431420793f121bf7a7f0376'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:18.172858 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c803c9435431420793f121bf7a7f0376'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:18.188317 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c803c9435431420793f121bf7a7f0376'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:18.201081 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1450/2881] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:36:17 2022] DELETE /identity/v3/users/c803c9435431420793f121bf7a7f0376 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:36:18.495303 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:36:18.497812 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:36:18.520796 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfdbf8-a3f6-4caf-82ff-80de0f6b6a2c admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:36:18.599528 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:36:18.600247 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:36:18.600493 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:36:18.600884 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] PATH_INFO: `/v3/projects/04900e5c6b054e7f93e8d5fa84b29bce` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:36:18.603331 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=04900e5c6b054e7f93e8d5fa84b29bce)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:36:18.605949 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:36:18.690711 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04900e5c6b054e7f93e8d5fa84b29bce', 'request_id': 'req-2c43f89b-92cb-4ece-9953-3c12c036f0fb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:18.704022 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04900e5c6b054e7f93e8d5fa84b29bce', 'request_id': 'req-2c43f89b-92cb-4ece-9953-3c12c036f0fb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:18.713089 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04900e5c6b054e7f93e8d5fa84b29bce', 'request_id': 'req-2c43f89b-92cb-4ece-9953-3c12c036f0fb'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:18.727693 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] The token cache is being invalidate because project 04900e5c6b054e7f93e8d5fa84b29bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79113) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:36:18.727943 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:18.728607 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:36:18.731285 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1432/2882] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:36:18 2022] DELETE /identity/v3/projects/04900e5c6b054e7f93e8d5fa84b29bce => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:37:30.895768 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:30.897205 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:30.959613 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291e67e-cb11-4925-a48e-a35ccec8d32a admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:31.015407 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f651f-1be1-4cb8-bad3-b57a616c132f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:31.016411 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f651f-1be1-4cb8-bad3-b57a616c132f service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:31.016814 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f651f-1be1-4cb8-bad3-b57a616c132f service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:31.017242 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f651f-1be1-4cb8-bad3-b57a616c132f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:31.020025 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-629f651f-1be1-4cb8-bad3-b57a616c132f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:31.086666 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f651f-1be1-4cb8-bad3-b57a616c132f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:31.088079 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f651f-1be1-4cb8-bad3-b57a616c132f service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:31.097513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1451/2883] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:37:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:37:31.172855 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:31.174642 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:31.276816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43f89b-92cb-4ece-9953-3c12c036f0fb admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:31.285782 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ba508-9c3e-4acf-b74e-8c1f61c1a110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43dd173265f24c69af4b13b61722eb51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:31.288514 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ba508-9c3e-4acf-b74e-8c1f61c1a110 service nova] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:31.289024 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ba508-9c3e-4acf-b74e-8c1f61c1a110 service nova] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:31.289679 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ba508-9c3e-4acf-b74e-8c1f61c1a110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:31.293007 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-798ba508-9c3e-4acf-b74e-8c1f61c1a110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:31.310181 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ba508-9c3e-4acf-b74e-8c1f61c1a110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:31.312113 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ba508-9c3e-4acf-b74e-8c1f61c1a110 service nova] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:31.327029 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1433/2884] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:37:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:37:36.438535 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f651f-1be1-4cb8-bad3-b57a616c132f service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:36.440377 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-629f651f-1be1-4cb8-bad3-b57a616c132f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:36.453190 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f651f-1be1-4cb8-bad3-b57a616c132f service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:36.457835 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa9cdd-3d6c-4bc0-b4d4-9195ae21bb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84470027e2824dc3a4b735d086de1300', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:36.458503 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa9cdd-3d6c-4bc0-b4d4-9195ae21bb6e service neutron] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:36.458963 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa9cdd-3d6c-4bc0-b4d4-9195ae21bb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:36.459227 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa9cdd-3d6c-4bc0-b4d4-9195ae21bb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:36.461288 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b6aa9cdd-3d6c-4bc0-b4d4-9195ae21bb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:36.524759 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa9cdd-3d6c-4bc0-b4d4-9195ae21bb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:36.526261 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa9cdd-3d6c-4bc0-b4d4-9195ae21bb6e service neutron] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:36.536930 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1452/2885] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 28 01:37:40.062090 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875d54-e959-49bd-a303-f25152e104b4 None None] REQUEST_METHOD: `POST` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:40.062993 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875d54-e959-49bd-a303-f25152e104b4 None None] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:40.063418 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875d54-e959-49bd-a303-f25152e104b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:40.097335 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.auth.core [None req-21875d54-e959-49bd-a303-f25152e104b4 None None] MFA Rules not processed for user `b3b098dc0f2f465f947df6e136b33f68`. Rule list: `[]` (Enabled: `True`). {{(pid=79113) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 28 01:37:40.098557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-21875d54-e959-49bd-a303-f25152e104b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:40.214512 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1434/2886] 10.222.0.16 () {58 vars in 967 bytes} [Fri Jan 28 01:37:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 28 01:37:40.263271 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa9cdd-3d6c-4bc0-b4d4-9195ae21bb6e service neutron] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:40.265068 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-b6aa9cdd-3d6c-4bc0-b4d4-9195ae21bb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:40.426661 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa9cdd-3d6c-4bc0-b4d4-9195ae21bb6e service neutron] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:40.435642 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1861d-2dd3-41d3-8f38-7f06d23063cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca65456d336b4c3898831af80e6435a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:40.436533 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1861d-2dd3-41d3-8f38-7f06d23063cc service swift] REQUEST_METHOD: `GET` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:40.436809 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1861d-2dd3-41d3-8f38-7f06d23063cc service swift] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:40.437083 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1861d-2dd3-41d3-8f38-7f06d23063cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:40.446515 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1861d-2dd3-41d3-8f38-7f06d23063cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:40.448274 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1861d-2dd3-41d3-8f38-7f06d23063cc service swift] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:40.457049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1453/2887] 10.222.0.16 () {60 vars in 1384 bytes} [Fri Jan 28 01:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 28 01:37:44.362625 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875d54-e959-49bd-a303-f25152e104b4 None None] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:44.363620 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-21875d54-e959-49bd-a303-f25152e104b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:44.423105 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875d54-e959-49bd-a303-f25152e104b4 None None] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:44.430293 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:44.432297 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:44.432678 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:44.433054 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] PATH_INFO: `/v3/users/64e0bc6be0d64ad794b70b72e9ac551e` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:44.444048 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e0bc6be0d64ad794b70b72e9ac551e)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:44.446602 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:44.513453 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e0bc6be0d64ad794b70b72e9ac551e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:44.522557 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e0bc6be0d64ad794b70b72e9ac551e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:44.534599 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e0bc6be0d64ad794b70b72e9ac551e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:44.535635 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e0bc6be0d64ad794b70b72e9ac551e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:44.547447 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e0bc6be0d64ad794b70b72e9ac551e'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:44.555646 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1435/2888] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:37:44 2022] DELETE /identity/v3/users/64e0bc6be0d64ad794b70b72e9ac551e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:37:44.777366 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1861d-2dd3-41d3-8f38-7f06d23063cc service swift] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:44.791804 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1861d-2dd3-41d3-8f38-7f06d23063cc service swift] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:44.860365 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:44.861285 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:44.861572 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:44.861842 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] PATH_INFO: `/v3/projects/842618ac233949f9bbd304fc37feff56` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:44.863106 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=842618ac233949f9bbd304fc37feff56)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:44.865084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:44.915611 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842618ac233949f9bbd304fc37feff56', 'request_id': 'req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:44.922679 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842618ac233949f9bbd304fc37feff56', 'request_id': 'req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:44.928760 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842618ac233949f9bbd304fc37feff56', 'request_id': 'req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:44.944650 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] The token cache is being invalidate because project 842618ac233949f9bbd304fc37feff56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:37:44.944872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:44.945942 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:44.947547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1454/2889] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:37:44 2022] DELETE /identity/v3/projects/842618ac233949f9bbd304fc37feff56 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:37:44.951748 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:44.953302 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:44.967263 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2f74d-dd08-4ef0-985d-c634dbd07620 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:45.033603 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:45.034371 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:45.034670 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:45.034941 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] PATH_INFO: `/v3/users/ed7398acbd86474999c7b3212a42c502` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:45.036305 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7398acbd86474999c7b3212a42c502)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:45.038281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:45.092381 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7398acbd86474999c7b3212a42c502'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:45.099361 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7398acbd86474999c7b3212a42c502'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:45.111149 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7398acbd86474999c7b3212a42c502'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:45.111932 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7398acbd86474999c7b3212a42c502'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:45.121718 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7398acbd86474999c7b3212a42c502'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:45.128698 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1436/2890] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:37:44 2022] DELETE /identity/v3/users/ed7398acbd86474999c7b3212a42c502 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:37:45.314084 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:45.315560 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:45.335939 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cc988-15e7-4ce9-ae1f-ac6341f0e24b admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:45.403266 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:45.404150 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:45.404440 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:45.404712 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] PATH_INFO: `/v3/projects/e126f8a879814d7eb33b84bd2cac482f` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:45.406116 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e126f8a879814d7eb33b84bd2cac482f)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:45.408055 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:45.456920 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e126f8a879814d7eb33b84bd2cac482f', 'request_id': 'req-081aa859-4e17-42f8-b469-0156f988f723'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:45.463028 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e126f8a879814d7eb33b84bd2cac482f', 'request_id': 'req-081aa859-4e17-42f8-b469-0156f988f723'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:45.469033 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e126f8a879814d7eb33b84bd2cac482f', 'request_id': 'req-081aa859-4e17-42f8-b469-0156f988f723'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:45.482715 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] The token cache is being invalidate because project e126f8a879814d7eb33b84bd2cac482f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:37:45.483005 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:45.483647 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:45.485434 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1455/2891] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:37:45 2022] DELETE /identity/v3/projects/e126f8a879814d7eb33b84bd2cac482f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:37:47.939272 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:47.940743 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:47.954358 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d481a2e-3936-48fe-bd66-3d6ba3361d04 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:48.014141 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:48.015162 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:48.015405 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:48.015700 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] PATH_INFO: `/v3/users/9af2b19a4b09402b9fc4a945b3c646ea` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:48.017026 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af2b19a4b09402b9fc4a945b3c646ea)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:48.018965 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:48.069724 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af2b19a4b09402b9fc4a945b3c646ea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.077117 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af2b19a4b09402b9fc4a945b3c646ea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.089686 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af2b19a4b09402b9fc4a945b3c646ea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.090441 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af2b19a4b09402b9fc4a945b3c646ea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.099659 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af2b19a4b09402b9fc4a945b3c646ea'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.105816 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1437/2892] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:37:47 2022] DELETE /identity/v3/users/9af2b19a4b09402b9fc4a945b3c646ea => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:37:48.283165 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:48.284853 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:48.298859 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081aa859-4e17-42f8-b469-0156f988f723 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:48.357072 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:48.357872 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:48.358159 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:48.358433 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] PATH_INFO: `/v3/projects/49054bd529dd4f6da0310f7fe1ef8f58` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:48.359615 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49054bd529dd4f6da0310f7fe1ef8f58)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:48.361606 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:48.409729 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49054bd529dd4f6da0310f7fe1ef8f58', 'request_id': 'req-10d20742-452e-48af-831e-b3d6f232d095'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.415623 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49054bd529dd4f6da0310f7fe1ef8f58', 'request_id': 'req-10d20742-452e-48af-831e-b3d6f232d095'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.421124 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49054bd529dd4f6da0310f7fe1ef8f58', 'request_id': 'req-10d20742-452e-48af-831e-b3d6f232d095'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.435231 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] The token cache is being invalidate because project 49054bd529dd4f6da0310f7fe1ef8f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:37:48.435547 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.436179 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.437778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1456/2893] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:37:48 2022] DELETE /identity/v3/projects/49054bd529dd4f6da0310f7fe1ef8f58 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:37:48.441892 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:48.443281 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:48.456966 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68303b5b-50c2-415c-94f9-de0c0fa9f249 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:48.515040 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:48.515890 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:48.516161 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:48.516464 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] PATH_INFO: `/v3/users/7d85b17c8c7548cc9f8706c63ee0e907` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:48.519201 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d85b17c8c7548cc9f8706c63ee0e907)` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:48.521677 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:48.568880 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d85b17c8c7548cc9f8706c63ee0e907'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.576664 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d85b17c8c7548cc9f8706c63ee0e907'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.589684 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d85b17c8c7548cc9f8706c63ee0e907'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.590501 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d85b17c8c7548cc9f8706c63ee0e907'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.600863 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.notifications [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d85b17c8c7548cc9f8706c63ee0e907'} {{(pid=79113) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.607257 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1438/2894] 10.222.0.16 () {58 vars in 1223 bytes} [Fri Jan 28 01:37:48 2022] DELETE /identity/v3/users/7d85b17c8c7548cc9f8706c63ee0e907 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 28 01:37:48.789383 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] Authenticating user token {{(pid=79114) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:37:48.790919 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.fernet_utils [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79114) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:37:48.808990 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d20742-452e-48af-831e-b3d6f232d095 admin admin] Validating token access rules against request {{(pid=79114) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:37:48.870427 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16dd35c2d4174b5ab9f9b2bf626a2af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '890dca85d3164528880613bf0afcbf95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79114) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:37:48.871247 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:37:48.871513 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] SCRIPT_NAME: `/identity` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:37:48.871778 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] PATH_INFO: `/v3/projects/f769158b372f49aeba3988cad6693727` {{(pid=79114) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:37:48.873104 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f769158b372f49aeba3988cad6693727)` {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:37:48.875049 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] RBAC: Authorization granted {{(pid=79114) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:37:48.927368 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f769158b372f49aeba3988cad6693727', 'request_id': 'req-08f0374d-d66b-4f6c-91ed-f2202dd5116d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.933621 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f769158b372f49aeba3988cad6693727', 'request_id': 'req-08f0374d-d66b-4f6c-91ed-f2202dd5116d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.941286 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f769158b372f49aeba3988cad6693727', 'request_id': 'req-08f0374d-d66b-4f6c-91ed-f2202dd5116d'} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.963968 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] The token cache is being invalidate because project f769158b372f49aeba3988cad6693727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79114) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 28 01:37:48.964241 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.965293 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: DEBUG keystone.notifications [None req-08f0374d-d66b-4f6c-91ed-f2202dd5116d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79114) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 28 01:37:48.967751 dv-cinder-826623-2-iscsi devstack@keystone.service[79114]: [pid: 79114|app: 0|req: 1457/2895] 10.222.0.16 () {58 vars in 1232 bytes} [Fri Jan 28 01:37:48 2022] DELETE /identity/v3/projects/f769158b372f49aeba3988cad6693727 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 28 01:39:16.847172 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] Authenticating user token {{(pid=79113) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 28 01:39:16.848878 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:39:16.946502 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355576e-792a-4687-9ee2-cec82fbd2544 admin admin] Validating token access rules against request {{(pid=79113) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 28 01:39:17.006773 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800de008-9f7b-40df-9729-3461d47b496c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac3e041554a4439bfa91520e52fbd2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '469b0b155bdc49d7b8c5a3294f4f7120', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79113) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 28 01:39:17.007414 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800de008-9f7b-40df-9729-3461d47b496c service placement] REQUEST_METHOD: `GET` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 28 01:39:17.007689 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800de008-9f7b-40df-9729-3461d47b496c service placement] SCRIPT_NAME: `/identity` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 28 01:39:17.007956 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800de008-9f7b-40df-9729-3461d47b496c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79113) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 28 01:39:17.009839 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.fernet_utils [None req-800de008-9f7b-40df-9729-3461d47b496c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79113) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 28 01:39:17.020919 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800de008-9f7b-40df-9729-3461d47b496c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 28 01:39:17.022525 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800de008-9f7b-40df-9729-3461d47b496c service placement] RBAC: Authorization granted {{(pid=79113) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 28 01:39:17.032316 dv-cinder-826623-2-iscsi devstack@keystone.service[79113]: [pid: 79113|app: 0|req: 1439/2896] 10.222.0.16 () {60 vars in 1365 bytes} [Fri Jan 28 01:39:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)